2024-04-01T15:07:24.509 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T15:07:24.509 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914 --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client} --name vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --verbose -- /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/orig.config.yaml 2024-04-01T15:07:24.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T15:07:24.645 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914 branch: wip-vshankar-testing-20240330.170739 description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client} email: vshankar@redhat.com first_in_suite: false job_id: '7633914' kernel: flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240330.170739 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240330.170739 sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 6891 sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 sleep_before_teardown: 0 subset: 932/1024 suite: fs suite_branch: wip-vshankar-testing-20240330.170739 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDnUHOvfKGdJEm2fodfNtmvZNnB+RGSUECNtfnLkPDR6jx+5cNpV1Cm0OTNCsKrk0zc9NUNPbM/M7JZwvW0v6MU= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfqfJJuK2zrLLFX5mk7FrAsOBmKCSPKLBp5b8hvInZnN6q4HxWgjBPJ2hvmrPj2ZpOqll5lKCE3BtNr1Y/BsWI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - workunit: clients: client.0: - client/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-04-01_14:09:42 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-01T15:07:24.646 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa; will attempt to use it 2024-04-01T15:07:24.647 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks 2024-04-01T15:07:24.647 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-01T15:07:24.649 INFO:teuthology.task.internal:Checking packages... 2024-04-01T15:07:24.675 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2271579d5e735cfd6d436b8349c004f06527cb0' 2024-04-01T15:07:24.675 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T15:07:24.675 INFO:teuthology.packaging:ref: None 2024-04-01T15:07:24.675 INFO:teuthology.packaging:tag: None 2024-04-01T15:07:24.675 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240330.170739 2024-04-01T15:07:24.675 INFO:teuthology.packaging:sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T15:07:24.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240330.170739 2024-04-01T15:07:24.893 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2574.gd2271579 2024-04-01T15:07:24.895 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-01T15:07:24.900 INFO:teuthology.task.internal:no buildpackages task found 2024-04-01T15:07:24.900 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-01T15:07:25.064 INFO:teuthology.task.internal:Saving configuration 2024-04-01T15:07:25.080 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-01T15:07:25.146 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T15:07:25.172 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 15:02:33.529712', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDnUHOvfKGdJEm2fodfNtmvZNnB+RGSUECNtfnLkPDR6jx+5cNpV1Cm0OTNCsKrk0zc9NUNPbM/M7JZwvW0v6MU='} 2024-04-01T15:07:25.191 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 15:02:33.532517', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfqfJJuK2zrLLFX5mk7FrAsOBmKCSPKLBp5b8hvInZnN6q4HxWgjBPJ2hvmrPj2ZpOqll5lKCE3BtNr1Y/BsWI='} 2024-04-01T15:07:25.191 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-01T15:07:25.197 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-01T15:07:25.197 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-01T15:07:25.197 INFO:teuthology.run_tasks:Running task console_log... 2024-04-01T15:07:25.294 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f82bc5b0f70>, signals=[15]) 2024-04-01T15:07:25.294 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-01T15:07:25.300 INFO:teuthology.task.internal:Opening connections... 2024-04-01T15:07:25.300 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:07:25.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:07:25.396 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:07:25.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:07:25.483 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-01T15:07:25.490 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-01T15:07:25.508 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-01T15:07:25.508 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-01T15:07:25.565 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-01T15:07:25.565 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-04-01T15:07:25.565 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-01T15:07:25.565 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-01T15:07:25.565 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-04-01T15:07:25.565 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-04-01T15:07:25.566 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T15:07:25.566 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-01T15:07:25.566 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-04-01T15:07:25.566 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T15:07:25.566 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-01T15:07:25.566 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T15:07:25.566 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T15:07:25.566 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T15:07:25.567 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-01T15:07:25.613 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-04-01T15:07:25.631 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-04-01T15:07:25.631 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-01T15:07:25.688 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-04-01T15:07:25.688 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-04-01T15:07:25.688 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-04-01T15:07:25.688 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-04-01T15:07:25.688 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-04-01T15:07:25.688 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-04-01T15:07:25.688 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T15:07:25.689 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-04-01T15:07:25.689 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-04-01T15:07:25.689 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T15:07:25.689 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-04-01T15:07:25.689 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T15:07:25.689 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T15:07:25.689 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T15:07:25.689 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-01T15:07:25.713 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-01T15:07:25.722 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-01T15:07:25.803 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-01T15:07:25.804 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-04-01T15:07:25.806 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-04-01T15:07:25.822 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-01T15:07:25.853 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-01T15:07:25.853 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-04-01T15:07:25.863 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-04-01T15:07:25.885 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-01T15:07:25.939 INFO:teuthology.run_tasks:Running task kernel... 2024-04-01T15:07:25.954 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-04-01T15:07:25.954 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, timeout 300 2024-04-01T15:07:25.954 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T15:07:25.955 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T15:07:25.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:07:25.970 DEBUG:teuthology.task.kernel:sha1 for mon.a is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T15:07:25.971 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-01T15:07:25.971 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-01T15:07:25.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:07:25.972 DEBUG:teuthology.task.kernel:sha1 for mon.b is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T15:07:25.972 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-01T15:07:25.972 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-04-01T15:07:26.027 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-361.el9.x86_64 2024-04-01T15:07:26.027 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T15:07:26.028 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-01T15:07:26.028 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T15:07:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-361.el9.x86_64 2024-04-01T15:07:26.032 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T15:07:26.032 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-01T15:07:26.032 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T15:07:26.261 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum upgrade -y linux-firmware 2024-04-01T15:07:26.265 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum upgrade -y linux-firmware 2024-04-01T15:07:28.321 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-04-01T15:07:28.469 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-01T15:07:29.886 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-04-01T15:07:29.938 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-04-01T15:07:30.812 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-01T15:07:30.969 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.0 MB 00:00 2024-04-01T15:07:32.913 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-01T15:07:36.103 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 19 MB 00:04 2024-04-01T15:07:37.788 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.1 MB 00:01 2024-04-01T15:07:39.322 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 16 kB 00:00 2024-04-01T15:07:40.370 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.1 MB 00:00 2024-04-01T15:07:41.835 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 21 MB 00:02 2024-04-01T15:07:41.838 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-04-01T15:07:45.384 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 21 MB 00:03 2024-04-01T15:07:46.839 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-01T15:07:49.286 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-01T15:07:49.291 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-01T15:07:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-01T15:07:49.291 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-01T15:07:49.291 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-04-01T15:07:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-01T15:07:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:07:49.292 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-01T15:07:49.292 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-01T15:07:49.292 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 1 Package 2024-04-01T15:07:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:07:49.292 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 375 M 2024-04-01T15:07:49.292 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-01T15:07:50.481 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-01T15:07:52.810 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 1 Package 2024-04-01T15:07:52.823 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:07:52.824 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 375 M 2024-04-01T15:07:52.824 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-04-01T15:08:00.997 INFO:teuthology.orchestra.run.smithi142.stdout:linux-firmware-20240219-143.el9.noarch.rpm 32 MB/s | 375 MB 00:11 2024-04-01T15:08:00.998 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-01T15:08:00.999 INFO:teuthology.orchestra.run.smithi142.stdout:Total 32 MB/s | 375 MB 00:11 2024-04-01T15:08:00.999 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-01T15:08:01.103 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-01T15:08:01.103 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-01T15:08:03.575 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-01T15:08:03.576 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-01T15:08:06.532 INFO:teuthology.orchestra.run.smithi179.stdout:linux-firmware-20240219-143.el9.noarch.rpm 27 MB/s | 375 MB 00:13 2024-04-01T15:08:06.533 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-04-01T15:08:06.533 INFO:teuthology.orchestra.run.smithi179.stdout:Total 27 MB/s | 375 MB 00:13 2024-04-01T15:08:06.534 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-04-01T15:08:06.626 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-04-01T15:08:06.626 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-04-01T15:08:09.031 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-04-01T15:08:09.032 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-04-01T15:08:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-01T15:08:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-01T15:08:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T15:08:11.586 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T15:08:11.586 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-01T15:08:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T15:08:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:08:11.987 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-04-01T15:08:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-01T15:08:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:08:11.987 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-01T15:08:12.272 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-04-01T15:08:12.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T15:08:12.580 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-04-01T15:08:12.580 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-01T15:08:12.582 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2024-04-01T15:08:15.486 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-04-01T15:08:15.735 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-01T15:08:15.826 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T15:08:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T15:08:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-01T15:08:17.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T15:08:17.366 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:08:17.366 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-04-01T15:08:17.366 INFO:teuthology.orchestra.run.smithi179.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-01T15:08:17.366 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:08:17.366 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-04-01T15:08:17.656 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-04-01T15:08:17.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T15:08:17.878 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-04-01T15:08:17.878 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-01T15:08:17.880 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi179.front.sepia.ceph.com to complete... 2024-04-01T15:09:02.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01 15:09:02 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-01T15:09:02.307 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2024-04-01 15:09:02-- 2024-04-01T15:09:02.307 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 50s 2024-04-01T15:09:02.307 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 321M in 49s (6.52 MB/s) 2024-04-01T15:09:02.310 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-04-01T15:09:02.311 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-01T15:09:04.273 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying... ######################################## 2024-04-01T15:09:04.394 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing... ######################################## 2024-04-01T15:09:04.475 INFO:teuthology.orchestra.run.smithi142.stdout:Updating / installing... 2024-04-01T15:09:12.028 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-04-01T15:09:15.257 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01 15:09:15 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-01T15:09:15.257 INFO:teuthology.orchestra.run.smithi179.stderr:FINISHED --2024-04-01 15:09:15-- 2024-04-01T15:09:15.257 INFO:teuthology.orchestra.run.smithi179.stderr:Total wall clock time: 57s 2024-04-01T15:09:15.257 INFO:teuthology.orchestra.run.smithi179.stderr:Downloaded: 1 files, 321M in 57s (5.65 MB/s) 2024-04-01T15:09:15.260 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-04-01T15:09:15.260 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-01T15:09:17.238 INFO:teuthology.orchestra.run.smithi179.stdout:Verifying... ######################################## 2024-04-01T15:09:17.327 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing... ######################################## 2024-04-01T15:09:17.406 INFO:teuthology.orchestra.run.smithi179.stdout:Updating / installing... 2024-04-01T15:09:24.882 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-04-01T15:09:25.814 INFO:teuthology.orchestra.run.smithi142.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-01T15:09:40.659 INFO:teuthology.orchestra.run.smithi179.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-01T15:09:48.270 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-01T15:09:48.271 DEBUG:teuthology.orchestra.run.smithi142:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-01T15:09:48.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-04-01T15:09:48.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-04-01T15:09:48.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-04-01T15:09:48.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-04-01T15:09:48.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-04-01T15:09:48.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-04-01T15:09:48.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-01T15:09:48.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-04-01T15:09:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-01T15:09:48.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-01T15:09:48.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-01T15:09:48.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-04-01T15:09:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-01T15:09:48.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-01T15:09:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-01T15:09:48.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-01T15:09:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-04-01T15:09:48.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-04-01T15:09:48.353 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-01T15:09:48.354 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-01T15:09:48.355 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-01T15:09:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-01T15:09:48.357 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-01T15:09:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-01T15:09:48.359 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-01T15:09:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-01T15:09:48.361 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-01T15:09:48.362 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-01T15:09:48.363 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-01T15:09:48.364 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-01T15:09:48.365 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-01T15:09:48.366 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-01T15:09:48.367 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-01T15:09:48.368 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-01T15:09:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-01T15:09:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-01T15:09:48.371 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-01T15:09:48.372 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-01T15:09:48.373 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-01T15:09:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-01T15:09:48.375 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-01T15:09:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-04-01T15:09:48.377 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-04-01T15:09:48.378 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-01T15:09:48.379 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-01T15:09:48.380 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-01T15:09:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-01T15:09:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-04-01T15:09:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-01T15:09:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-01T15:09:48.385 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-01T15:09:48.386 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-01T15:09:48.387 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-04-01T15:09:48.388 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-01T15:09:48.389 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-01T15:09:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-01T15:09:48.391 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-01T15:09:48.392 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-01T15:09:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-01T15:09:48.394 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-01T15:09:48.395 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-04-01T15:09:48.396 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-01T15:09:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-01T15:09:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-01T15:09:48.399 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-01T15:09:48.400 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-01T15:09:48.401 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-01T15:09:48.402 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-04-01T15:09:48.403 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-04-01T15:09:48.404 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-01T15:09:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-01T15:09:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-01T15:09:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-01T15:09:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-01T15:09:48.409 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-01T15:09:48.410 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-01T15:09:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-01T15:09:48.412 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-01T15:09:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-01T15:09:48.414 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-01T15:09:48.415 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-01T15:09:48.416 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-01T15:09:48.417 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-01T15:09:48.418 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-01T15:09:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-01T15:09:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-04-01T15:09:48.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-01T15:09:48.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-01T15:09:48.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-01T15:09:48.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-01T15:09:48.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-01T15:09:48.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-01T15:09:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-01T15:09:48.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-01T15:09:48.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-01T15:09:48.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-01T15:09:48.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-04-01T15:09:48.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-04-01T15:09:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-04-01T15:09:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-01T15:09:48.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-01T15:09:48.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-01T15:09:48.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-01T15:09:48.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-01T15:09:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-01T15:09:48.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-04-01T15:09:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-04-01T15:09:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-01T15:09:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-04-01T15:09:48.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-01T15:09:48.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-04-01T15:09:48.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-01T15:09:48.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-01T15:09:48.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-01T15:09:48.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-01T15:09:48.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-01T15:09:48.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-01T15:09:48.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-01T15:09:48.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-01T15:09:48.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-01T15:09:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-01T15:09:48.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-01T15:09:48.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-01T15:09:48.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-01T15:09:48.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-01T15:09:48.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-01T15:09:48.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-01T15:09:48.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-01T15:09:48.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-01T15:09:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-01T15:09:48.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-04-01T15:09:48.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-01T15:09:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-01T15:09:48.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-01T15:09:48.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-04-01T15:09:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-04-01T15:09:48.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-01T15:09:48.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-01T15:09:48.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-01T15:09:48.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-01T15:09:48.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-01T15:09:48.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-01T15:09:48.477 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-01T15:09:48.477 DEBUG:teuthology.orchestra.run.smithi142:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout:postinstall scriptlet (using /bin/sh): 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout:for file in vmlinuz System.map config; do 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: fi 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout:done 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-04-01T15:09:48.500 INFO:teuthology.orchestra.run.smithi142.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-04-01T15:09:48.501 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-04-01T15:09:48.501 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-04-01T15:09:48.501 INFO:teuthology.orchestra.run.smithi142.stdout:postuninstall scriptlet (using /bin/sh): 2024-04-01T15:09:48.501 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/update-bootloader ]; then 2024-04-01T15:09:48.501 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-04-01T15:09:48.501 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-04-01T15:09:48.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-04-01T15:09:48.590 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-04-01T15:09:48.590 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-04-01T15:09:48.590 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-04-01T15:09:48.590 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2024-04-01T15:09:48.590 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-01T15:09:48.591 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-04-01T15:09:48.592 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-04-01T15:09:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:09:48.592 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-01T15:09:48.592 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-01T15:09:48.592 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-01T15:09:48.592 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-04-01T15:09:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:09:48.592 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-04-01T15:09:48.593 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-01T15:09:48.593 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 6.8.0-g1df0c7e8a235 2024-04-01T15:09:48.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-01T15:09:49.126 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-04-01T15:09:50.559 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-01T15:09:50.602 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-04-01T15:09:50.604 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-01T15:09:50.619 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.nGYmvSUDDI 2024-04-01T15:09:50.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nGYmvSUDDI 2024-04-01T15:09:50.687 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.nGYmvSUDDI 2024-04-01T15:09:50.816 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.nGYmvSUDDI is 6KB 2024-04-01T15:09:50.864 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.nGYmvSUDDI 2024-04-01T15:09:50.878 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-04-01T15:09:50.945 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-01T15:09:50.946 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-01T15:09:50.946 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-01T15:09:50.946 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-04-01T15:09:50.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-04-01T15:09:51.095 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-04-01T15:10:03.297 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-01T15:10:03.297 DEBUG:teuthology.orchestra.run.smithi179:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-01T15:10:03.382 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-04-01T15:10:03.382 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-04-01T15:10:03.382 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-04-01T15:10:03.382 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-04-01T15:10:03.382 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-04-01T15:10:03.382 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-04-01T15:10:03.382 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-04-01T15:10:03.382 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-01T15:10:03.382 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-01T15:10:03.383 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-01T15:10:03.384 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-01T15:10:03.385 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-01T15:10:03.386 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-01T15:10:03.387 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-01T15:10:03.388 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-01T15:10:03.389 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-01T15:10:03.390 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-01T15:10:03.391 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-01T15:10:03.392 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-04-01T15:10:03.393 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-04-01T15:10:03.394 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-04-01T15:10:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-01T15:10:03.396 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-01T15:10:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-01T15:10:03.398 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-01T15:10:03.399 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-01T15:10:03.400 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-01T15:10:03.401 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-01T15:10:03.402 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-01T15:10:03.403 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-01T15:10:03.404 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-01T15:10:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-01T15:10:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-01T15:10:03.407 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-01T15:10:03.408 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-01T15:10:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-01T15:10:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-01T15:10:03.411 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-01T15:10:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-01T15:10:03.413 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-01T15:10:03.414 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-01T15:10:03.415 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-01T15:10:03.416 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-01T15:10:03.417 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-01T15:10:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-01T15:10:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-04-01T15:10:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-01T15:10:03.421 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-01T15:10:03.422 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-01T15:10:03.423 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-04-01T15:10:03.424 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-01T15:10:03.425 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-01T15:10:03.426 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-01T15:10:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-04-01T15:10:03.428 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-01T15:10:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-01T15:10:03.430 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-01T15:10:03.431 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-01T15:10:03.432 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-01T15:10:03.433 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-01T15:10:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-01T15:10:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-01T15:10:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-01T15:10:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-01T15:10:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-01T15:10:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-04-01T15:10:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-01T15:10:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-01T15:10:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-01T15:10:03.443 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-01T15:10:03.444 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-01T15:10:03.445 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-01T15:10:03.446 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-01T15:10:03.447 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-01T15:10:03.448 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-01T15:10:03.449 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-01T15:10:03.450 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-04-01T15:10:03.451 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-01T15:10:03.452 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-04-01T15:10:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-04-01T15:10:03.454 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-01T15:10:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-01T15:10:03.456 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-01T15:10:03.457 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-01T15:10:03.458 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-01T15:10:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-01T15:10:03.460 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-01T15:10:03.461 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-01T15:10:03.462 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-01T15:10:03.463 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-01T15:10:03.464 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-04-01T15:10:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-01T15:10:03.466 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-04-01T15:10:03.467 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-04-01T15:10:03.468 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-01T15:10:03.469 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-01T15:10:03.470 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-01T15:10:03.471 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-01T15:10:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-01T15:10:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-01T15:10:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-01T15:10:03.475 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-01T15:10:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-01T15:10:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-04-01T15:10:03.478 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-04-01T15:10:03.479 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-01T15:10:03.480 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-01T15:10:03.481 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-01T15:10:03.482 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-04-01T15:10:03.483 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-04-01T15:10:03.484 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-04-01T15:10:03.485 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-01T15:10:03.486 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-04-01T15:10:03.487 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-04-01T15:10:03.488 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-01T15:10:03.489 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-01T15:10:03.490 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-01T15:10:03.491 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-01T15:10:03.492 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-04-01T15:10:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-01T15:10:03.494 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-04-01T15:10:03.495 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-01T15:10:03.496 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-01T15:10:03.497 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-01T15:10:03.498 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-01T15:10:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-04-01T15:10:03.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-01T15:10:03.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-01T15:10:03.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-01T15:10:03.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-01T15:10:03.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-04-01T15:10:03.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-01T15:10:03.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-04-01T15:10:03.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-01T15:10:03.500 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-01T15:10:03.501 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-01T15:10:03.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-01T15:10:03.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-01T15:10:03.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-01T15:10:03.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-01T15:10:03.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-01T15:10:03.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-01T15:10:03.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-01T15:10:03.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-01T15:10:03.502 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-04-01T15:10:03.503 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-01T15:10:03.504 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-01T15:10:03.505 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-01T15:10:03.506 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-01T15:10:03.507 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-01T15:10:03.508 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-01T15:10:03.509 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-01T15:10:03.510 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-01T15:10:03.511 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-01T15:10:03.512 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-01T15:10:03.513 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-01T15:10:03.514 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-01T15:10:03.515 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-01T15:10:03.516 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-01T15:10:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-01T15:10:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-04-01T15:10:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-01T15:10:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-01T15:10:03.521 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-01T15:10:03.522 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-01T15:10:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-01T15:10:03.524 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-04-01T15:10:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-01T15:10:03.526 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-01T15:10:03.527 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-01T15:10:03.528 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-01T15:10:03.529 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-01T15:10:03.530 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-01T15:10:03.531 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-01T15:10:03.532 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-01T15:10:03.536 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-01T15:10:03.536 DEBUG:teuthology.orchestra.run.smithi179:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-01T15:10:03.557 INFO:teuthology.orchestra.run.smithi179.stdout:postinstall scriptlet (using /bin/sh): 2024-04-01T15:10:03.557 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-01T15:10:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:for file in vmlinuz System.map config; do 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: fi 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:done 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-04-01T15:10:03.558 INFO:teuthology.orchestra.run.smithi179.stdout:postuninstall scriptlet (using /bin/sh): 2024-04-01T15:10:03.559 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/update-bootloader ]; then 2024-04-01T15:10:03.559 INFO:teuthology.orchestra.run.smithi179.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-04-01T15:10:03.559 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2024-04-01T15:10:03.560 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2024-04-01T15:10:03.633 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2024-04-01T15:10:03.633 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2024-04-01T15:10:03.633 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.06 2024-04-01T15:10:03.633 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 68.el9 2024-04-01T15:10:03.633 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Group : Unspecified 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 8264254 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : builder@centos.org 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : CentOS 2024-04-01T15:10:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-01T15:10:03.635 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2024-04-01T15:10:03.635 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2024-04-01T15:10:03.635 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:10:03.635 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-01T15:10:03.635 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-01T15:10:03.635 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-01T15:10:03.635 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2024-04-01T15:10:03.635 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:10:03.635 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2024-04-01T15:10:03.636 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-01T15:10:03.636 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 6.8.0-g1df0c7e8a235 2024-04-01T15:10:03.636 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-01T15:10:04.238 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-04-01T15:10:05.662 INFO:teuthology.orchestra.run.smithi179.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-01T15:10:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-04-01T15:10:05.700 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-04-01T15:10:05.715 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.tlwiPpCzqg 2024-04-01T15:10:05.715 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tlwiPpCzqg 2024-04-01T15:10:05.783 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.tlwiPpCzqg 2024-04-01T15:10:05.925 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.tlwiPpCzqg is 6KB 2024-04-01T15:10:05.974 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.tlwiPpCzqg 2024-04-01T15:10:05.988 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2024-04-01T15:10:06.052 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-01T15:10:06.052 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-01T15:10:06.052 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-01T15:10:06.053 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-04-01T15:10:06.054 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-04-01T15:10:06.215 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-04-01T15:10:21.099 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-01T15:10:21.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-01T15:10:21.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:10:36.230 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-01T15:10:36.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-01T15:10:36.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:10:39.646 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-01T15:10:48.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-01T15:10:48.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:10:51.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-01T15:10:54.750 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-01T15:11:03.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-01T15:11:03.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:11:03.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-01T15:11:03.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:11:06.814 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-01T15:11:18.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-01T15:11:18.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:11:50.807 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-01T15:11:51.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-01T15:11:51.411 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g1df0c7e8a235"... 2024-04-01T15:11:51.412 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-04-01T15:11:51.450 INFO:teuthology.orchestra.run.smithi179.stdout:6.8.0-g1df0c7e8a235 2024-04-01T15:11:51.450 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-01T15:11:51.450 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T15:11:51.450 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-01T15:11:52.451 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-01T15:11:52.451 DEBUG:teuthology.orchestra.run.smithi179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T15:11:52.562 INFO:teuthology.orchestra.run.smithi179.stdout:ttyS1 2024-04-01T15:11:52.609 DEBUG:teuthology.parallel:result is None 2024-04-01T15:12:03.723 DEBUG:teuthology.orchestra.remote:timed out 2024-04-01T15:12:18.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-01T15:12:18.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:12:19.234 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-01T15:12:19.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-01T15:12:19.879 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g1df0c7e8a235"... 2024-04-01T15:12:19.879 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-01T15:12:19.932 INFO:teuthology.orchestra.run.smithi142.stdout:6.8.0-g1df0c7e8a235 2024-04-01T15:12:19.932 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-01T15:12:19.932 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T15:12:19.932 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-01T15:12:20.933 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-01T15:12:20.933 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T15:12:21.070 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-04-01T15:12:21.132 DEBUG:teuthology.parallel:result is None 2024-04-01T15:12:21.133 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-01T15:12:21.142 INFO:teuthology.task.internal:Creating test directory... 2024-04-01T15:12:21.142 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T15:12:21.149 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T15:12:21.208 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-01T15:12:21.221 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-01T15:12:21.310 INFO:teuthology.task.internal:Creating archive directory... 2024-04-01T15:12:21.310 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T15:12:21.317 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T15:12:21.694 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-01T15:12:21.701 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-01T15:12:21.701 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T15:12:21.709 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T15:12:21.807 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T15:12:21.819 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T15:12:21.849 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T15:12:21.863 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T15:12:21.867 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-01T15:12:21.875 INFO:teuthology.task.internal:Configuring sudo... 2024-04-01T15:12:21.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T15:12:21.880 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T15:12:21.975 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-01T15:12:21.984 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-01T15:12:21.985 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T15:12:21.992 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T15:12:22.046 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T15:12:22.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T15:12:22.243 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T15:12:22.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T15:12:22.416 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:12:22.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T15:12:22.511 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T15:12:22.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T15:12:22.730 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T15:12:22.814 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T15:12:22.908 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:12:22.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T15:12:22.997 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-04-01T15:12:23.004 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-04-01T15:12:23.116 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T15:12:23.174 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T15:12:23.450 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-01T15:12:23.458 INFO:teuthology.task.internal:Starting timer... 2024-04-01T15:12:23.458 INFO:teuthology.run_tasks:Running task pcp... 2024-04-01T15:12:23.500 INFO:teuthology.run_tasks:Running task selinux... 2024-04-01T15:12:23.525 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-01T15:12:23.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-04-01T15:12:23.658 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-04-01T15:12:23.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-04-01T15:12:23.814 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-04-01T15:12:23.819 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-01T15:12:23.819 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-04-01T15:12:23.872 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-04-01T15:12:23.872 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-04-01T15:12:23.940 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-04-01T15:12:23.941 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi142.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2024-04-01T15:12:23.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T15:12:24.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:12:24.029 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T15:12:24.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:12:24.108 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-01T15:12:24.108 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-04-01T15:12:24.213 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-04-01T15:12:24.302 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-01T15:12:24.311 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-01T15:12:24.316 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-01T15:12:24.437 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-01T15:12:24.451 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-01T15:12:24.453 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi142.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-01T15:18:22.034 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi142.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-04-01T15:18:22.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-01T15:18:22.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:18:22.178 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-01T15:18:22.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-01T15:18:22.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-01T15:18:22.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T15:18:22.471 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-01T15:18:22.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-01T15:18:22.633 INFO:teuthology.run_tasks:Running task clock... 2024-04-01T15:18:22.696 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-01T15:18:22.696 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T15:18:22.697 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T15:18:22.705 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T15:18:22.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T15:18:22.800 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T15:18:22.806 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T15:18:22.852 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T15:18:22.859 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T15:18:22.946 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-04-01T15:18:22.954 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-04-01T15:18:22.990 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-04-01T15:18:22.997 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-04-01T15:18:23.043 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T15:18:23.050 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T15:18:23.098 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T15:18:23.104 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T15:18:23.226 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-04-01T15:18:23.233 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-04-01T15:18:23.234 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T15:18:23.235 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-04-01T15:18:23.235 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:18:23.235 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:18:23.235 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:18:23.235 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:18:23.241 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T15:18:23.241 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-04-01T15:18:23.241 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:18:23.241 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:18:23.241 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:18:23.241 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:18:23.242 INFO:teuthology.run_tasks:Running task install... 2024-04-01T15:18:23.255 DEBUG:teuthology.task.install:project ceph 2024-04-01T15:18:23.255 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}} 2024-04-01T15:18:23.255 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'} 2024-04-01T15:18:23.255 INFO:teuthology.task.install:Using flavor: default 2024-04-01T15:18:23.262 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-01T15:18:23.262 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-01T15:18:23.263 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'tag': None, 'wait_for_package': False} 2024-04-01T15:18:23.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T15:18:23.266 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'tag': None, 'wait_for_package': False} 2024-04-01T15:18:23.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T15:18:23.410 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/ 2024-04-01T15:18:23.410 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2574.gd2271579 2024-04-01T15:18:23.421 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/ 2024-04-01T15:18:23.421 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2574.gd2271579 2024-04-01T15:18:23.708 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T15:18:23.708 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:18:23.708 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T15:18:23.722 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T15:18:23.722 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:18:23.722 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T15:18:23.805 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-01T15:18:23.805 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2271579d5e735cfd6d436b8349c004f06527cb0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T15:18:23.822 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-01T15:18:23.822 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2271579d5e735cfd6d436b8349c004f06527cb0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T15:18:23.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T15:18:23.962 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T15:18:24.073 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T15:18:24.090 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T15:18:24.165 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-04-01T15:18:24.169 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-04-01T15:18:24.176 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-04-01T15:18:24.180 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-04-01T15:18:24.525 INFO:teuthology.orchestra.run.smithi179.stdout:74 files removed 2024-04-01T15:18:24.526 INFO:teuthology.orchestra.run.smithi142.stdout:74 files removed 2024-04-01T15:18:24.565 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-01T15:18:24.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-01T15:18:26.059 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 85 kB/s | 83 kB 00:00 2024-04-01T15:18:26.230 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 72 kB/s | 83 kB 00:01 2024-04-01T15:18:27.026 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 13 kB/s | 12 kB 00:00 2024-04-01T15:18:27.289 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 12 kB/s | 12 kB 00:00 2024-04-01T15:18:28.018 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 2.0 kB/s | 1.9 kB 00:00 2024-04-01T15:18:28.239 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2024-04-01T15:18:28.689 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-04-01T15:18:28.885 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-01T15:18:30.472 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-04-01T15:18:30.702 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2024-04-01T15:18:32.251 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.0 MB 00:01 2024-04-01T15:18:32.473 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.0 MB 00:01 2024-04-01T15:18:35.323 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-04-01T15:18:35.461 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 19 MB 00:01 2024-04-01T15:18:39.883 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.1 MB 00:00 2024-04-01T15:18:40.011 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.1 MB 00:00 2024-04-01T15:18:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-01T15:18:41.862 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-04-01T15:18:43.462 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-01T15:18:43.818 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-01T15:18:49.397 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-01T15:18:49.680 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-01T15:18:52.195 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T15:18:52.196 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T15:18:52.217 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-01T15:18:52.219 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-01T15:18:52.220 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-01T15:18:52.221 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-01T15:18:52.224 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-01T15:18:52.227 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-01T15:18:52.229 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-01T15:18:52.316 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-01T15:18:52.345 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-04-01T15:18:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-01T15:18:52.345 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-04-01T15:18:52.345 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-01T15:18:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-01T15:18:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.0.0-2574.gd2271579.el9 ceph 6.6 k 2024-04-01T15:18:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.4 M 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 889 k 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2574.gd2271579.el9 ceph 145 k 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.5 M 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 141 k 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 3.5 M 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 7.4 M 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 49 k 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 9.8 M 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.0.0-2574.gd2271579.el9 ceph 48 M 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 264 k 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 762 k 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 225 k 2024-04-01T15:18:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell x86_64 2:19.0.0-2574.gd2271579.el9 ceph 27 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 18 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 32 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 746 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 127 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-01T15:18:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.0.0-2574.gd2271579.el9 ceph 162 k 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.0.0-2574.gd2271579.el9 ceph 320 k 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 298 k 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 99 k 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 85 k 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 171 k 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-04-01T15:18:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.4 M 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-01T15:18:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 21 M 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 34 k 2024-04-01T15:18:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.0.0-2574.gd2271579.el9 ceph 2.4 M 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 249 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.0.0-2574.gd2271579.el9 ceph 4.7 M 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 17 M 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 16 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.0.0-2574.gd2271579.el9 ceph 25 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-01T15:18:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.0.0-2574.gd2271579.el9 ceph 163 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 501 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.1 M 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-01T15:18:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 45 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 134 k 2024-04-01T15:18:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-01T15:18:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-01T15:18:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-01T15:18:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-01T15:18:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout:Install 150 Packages 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 24 Packages 2024-04-01T15:18:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:18:52.359 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 226 M 2024-04-01T15:18:52.359 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-01T15:18:52.407 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T15:18:52.409 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T15:18:52.431 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-01T15:18:52.432 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-01T15:18:52.433 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-01T15:18:52.434 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-01T15:18:52.437 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-01T15:18:52.441 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-01T15:18:52.442 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-01T15:18:52.529 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================================ 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================================ 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:19.0.0-2574.gd2271579.el9 ceph 6.6 k 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.4 M 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 889 k 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2574.gd2271579.el9 ceph 145 k 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.5 M 2024-04-01T15:18:52.558 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 141 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 3.5 M 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 7.4 M 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 49 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 9.8 M 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:19.0.0-2574.gd2271579.el9 ceph 48 M 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 264 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 762 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 225 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell x86_64 2:19.0.0-2574.gd2271579.el9 ceph 27 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 18 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 32 k 2024-04-01T15:18:52.559 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 746 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 127 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:19.0.0-2574.gd2271579.el9 ceph 162 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:19.0.0-2574.gd2271579.el9 ceph 320 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 298 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 99 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 85 k 2024-04-01T15:18:52.560 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 171 k 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-01T15:18:52.561 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.4 M 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-01T15:18:52.562 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 21 M 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 34 k 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:19.0.0-2574.gd2271579.el9 ceph 2.4 M 2024-04-01T15:18:52.563 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 249 k 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:19.0.0-2574.gd2271579.el9 ceph 4.7 M 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 17 M 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 16 k 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:19.0.0-2574.gd2271579.el9 ceph 25 k 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-01T15:18:52.564 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:19.0.0-2574.gd2271579.el9 ceph 163 k 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-01T15:18:52.565 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 501 k 2024-04-01T15:18:52.566 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-01T15:18:52.566 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.1 M 2024-04-01T15:18:52.566 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-01T15:18:52.566 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-01T15:18:52.566 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-01T15:18:52.566 INFO:teuthology.orchestra.run.smithi179.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-01T15:18:52.567 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 45 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 134 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-01T15:18:52.568 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-01T15:18:52.569 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-01T15:18:52.570 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-01T15:18:52.571 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout:Installing weak dependencies: 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-01T15:18:52.572 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:18:52.573 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-04-01T15:18:52.573 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================================ 2024-04-01T15:18:52.573 INFO:teuthology.orchestra.run.smithi179.stdout:Install 150 Packages 2024-04-01T15:18:52.573 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 24 Packages 2024-04-01T15:18:52.573 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:18:52.573 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 226 M 2024-04-01T15:18:52.573 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-04-01T15:18:53.320 INFO:teuthology.orchestra.run.smithi179.stdout:(1/174): ceph-19.0.0-2574.gd2271579.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-04-01T15:18:53.373 INFO:teuthology.orchestra.run.smithi142.stdout:(1/174): ceph-19.0.0-2574.gd2271579.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-04-01T15:18:54.145 INFO:teuthology.orchestra.run.smithi179.stdout:(2/174): ceph-fuse-19.0.0-2574.gd2271579.el9.x8 1.1 MB/s | 889 kB 00:00 2024-04-01T15:18:54.245 INFO:teuthology.orchestra.run.smithi179.stdout:(3/174): ceph-immutable-object-cache-19.0.0-257 1.4 MB/s | 145 kB 00:00 2024-04-01T15:18:54.348 INFO:teuthology.orchestra.run.smithi142.stdout:(2/174): ceph-fuse-19.0.0-2574.gd2271579.el9.x8 913 kB/s | 889 kB 00:00 2024-04-01T15:18:54.524 INFO:teuthology.orchestra.run.smithi142.stdout:(3/174): ceph-immutable-object-cache-19.0.0-257 829 kB/s | 145 kB 00:00 2024-04-01T15:18:55.287 INFO:teuthology.orchestra.run.smithi179.stdout:(4/174): ceph-mds-19.0.0-2574.gd2271579.el9.x86 2.3 MB/s | 2.4 MB 00:01 2024-04-01T15:18:55.770 INFO:teuthology.orchestra.run.smithi179.stdout:(5/174): ceph-mgr-19.0.0-2574.gd2271579.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-04-01T15:18:55.857 INFO:teuthology.orchestra.run.smithi142.stdout:(4/174): ceph-mds-19.0.0-2574.gd2271579.el9.x86 1.8 MB/s | 2.4 MB 00:01 2024-04-01T15:18:56.924 INFO:teuthology.orchestra.run.smithi142.stdout:(5/174): ceph-mgr-19.0.0-2574.gd2271579.el9.x86 1.4 MB/s | 1.5 MB 00:01 2024-04-01T15:18:57.170 INFO:teuthology.orchestra.run.smithi179.stdout:(6/174): ceph-mon-19.0.0-2574.gd2271579.el9.x86 3.4 MB/s | 4.7 MB 00:01 2024-04-01T15:18:58.229 INFO:teuthology.orchestra.run.smithi179.stdout:(7/174): ceph-base-19.0.0-2574.gd2271579.el9.x8 1.0 MB/s | 5.4 MB 00:05 2024-04-01T15:18:59.532 INFO:teuthology.orchestra.run.smithi142.stdout:(6/174): ceph-base-19.0.0-2574.gd2271579.el9.x8 835 kB/s | 5.4 MB 00:06 2024-04-01T15:18:59.840 INFO:teuthology.orchestra.run.smithi142.stdout:(7/174): ceph-mon-19.0.0-2574.gd2271579.el9.x86 1.6 MB/s | 4.7 MB 00:02 2024-04-01T15:19:01.121 INFO:teuthology.orchestra.run.smithi179.stdout:(8/174): ceph-osd-19.0.0-2574.gd2271579.el9.x86 4.3 MB/s | 17 MB 00:03 2024-04-01T15:19:01.229 INFO:teuthology.orchestra.run.smithi179.stdout:(9/174): ceph-selinux-19.0.0-2574.gd2271579.el9 233 kB/s | 25 kB 00:00 2024-04-01T15:19:06.173 INFO:teuthology.orchestra.run.smithi142.stdout:(8/174): ceph-radosgw-19.0.0-2574.gd2271579.el9 1.6 MB/s | 9.8 MB 00:06 2024-04-01T15:19:06.274 INFO:teuthology.orchestra.run.smithi142.stdout:(9/174): ceph-selinux-19.0.0-2574.gd2271579.el9 254 kB/s | 25 kB 00:00 2024-04-01T15:19:06.629 INFO:teuthology.orchestra.run.smithi179.stdout:(10/174): ceph-radosgw-19.0.0-2574.gd2271579.el 1.2 MB/s | 9.8 MB 00:08 2024-04-01T15:19:06.904 INFO:teuthology.orchestra.run.smithi179.stdout:(11/174): cephfs-mirror-19.0.0-2574.gd2271579.e 822 kB/s | 225 kB 00:00 2024-04-01T15:19:07.029 INFO:teuthology.orchestra.run.smithi179.stdout:(12/174): cephfs-shell-19.0.0-2574.gd2271579.el 218 kB/s | 27 kB 00:00 2024-04-01T15:19:07.146 INFO:teuthology.orchestra.run.smithi179.stdout:(13/174): libcephfs-devel-19.0.0-2574.gd2271579 274 kB/s | 32 kB 00:00 2024-04-01T15:19:07.747 INFO:teuthology.orchestra.run.smithi179.stdout:(14/174): libcephfs2-19.0.0-2574.gd2271579.el9. 1.2 MB/s | 746 kB 00:00 2024-04-01T15:19:07.963 INFO:teuthology.orchestra.run.smithi179.stdout:(15/174): libcephsqlite-19.0.0-2574.gd2271579.e 757 kB/s | 163 kB 00:00 2024-04-01T15:19:08.089 INFO:teuthology.orchestra.run.smithi179.stdout:(16/174): librados-devel-19.0.0-2574.gd2271579. 1.0 MB/s | 127 kB 00:00 2024-04-01T15:19:08.497 INFO:teuthology.orchestra.run.smithi179.stdout:(17/174): libradosstriper1-19.0.0-2574.gd227157 1.2 MB/s | 501 kB 00:00 2024-04-01T15:19:12.556 INFO:teuthology.orchestra.run.smithi179.stdout:(18/174): librgw2-19.0.0-2574.gd2271579.el9.x86 1.3 MB/s | 5.1 MB 00:04 2024-04-01T15:19:12.664 INFO:teuthology.orchestra.run.smithi179.stdout:(19/174): python3-ceph-argparse-19.0.0-2574.gd2 421 kB/s | 45 kB 00:00 2024-04-01T15:19:13.048 INFO:teuthology.orchestra.run.smithi142.stdout:(10/174): ceph-osd-19.0.0-2574.gd2271579.el9.x8 1.2 MB/s | 17 MB 00:13 2024-04-01T15:19:13.106 INFO:teuthology.orchestra.run.smithi179.stdout:(20/174): ceph-common-19.0.0-2574.gd2271579.el9 1.0 MB/s | 21 MB 00:20 2024-04-01T15:19:13.206 INFO:teuthology.orchestra.run.smithi179.stdout:(21/174): python3-ceph-common-19.0.0-2574.gd227 248 kB/s | 134 kB 00:00 2024-04-01T15:19:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:(11/174): cephfs-mirror-19.0.0-2574.gd2271579.e 1.3 MB/s | 225 kB 00:00 2024-04-01T15:19:13.365 INFO:teuthology.orchestra.run.smithi142.stdout:(12/174): cephfs-shell-19.0.0-2574.gd2271579.el 192 kB/s | 27 kB 00:00 2024-04-01T15:19:13.381 INFO:teuthology.orchestra.run.smithi179.stdout:(22/174): python3-cephfs-19.0.0-2574.gd2271579. 591 kB/s | 162 kB 00:00 2024-04-01T15:19:13.490 INFO:teuthology.orchestra.run.smithi142.stdout:(13/174): libcephfs-devel-19.0.0-2574.gd2271579 255 kB/s | 32 kB 00:00 2024-04-01T15:19:13.590 INFO:teuthology.orchestra.run.smithi179.stdout:(23/174): python3-rados-19.0.0-2574.gd2271579.e 836 kB/s | 320 kB 00:00 2024-04-01T15:19:13.699 INFO:teuthology.orchestra.run.smithi179.stdout:(24/174): python3-rbd-19.0.0-2574.gd2271579.el9 939 kB/s | 298 kB 00:00 2024-04-01T15:19:13.807 INFO:teuthology.orchestra.run.smithi179.stdout:(25/174): python3-rgw-19.0.0-2574.gd2271579.el9 459 kB/s | 99 kB 00:00 2024-04-01T15:19:13.849 INFO:teuthology.orchestra.run.smithi179.stdout:(26/174): rbd-fuse-19.0.0-2574.gd2271579.el9.x8 573 kB/s | 85 kB 00:00 2024-04-01T15:19:13.907 INFO:teuthology.orchestra.run.smithi142.stdout:(14/174): libcephfs2-19.0.0-2574.gd2271579.el9. 1.8 MB/s | 746 kB 00:00 2024-04-01T15:19:14.066 INFO:teuthology.orchestra.run.smithi142.stdout:(15/174): libcephsqlite-19.0.0-2574.gd2271579.e 1.0 MB/s | 163 kB 00:00 2024-04-01T15:19:14.100 INFO:teuthology.orchestra.run.smithi179.stdout:(27/174): rbd-nbd-19.0.0-2574.gd2271579.el9.x86 685 kB/s | 171 kB 00:00 2024-04-01T15:19:14.158 INFO:teuthology.orchestra.run.smithi142.stdout:(16/174): librados-devel-19.0.0-2574.gd2271579. 1.4 MB/s | 127 kB 00:00 2024-04-01T15:19:14.208 INFO:teuthology.orchestra.run.smithi179.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2574.g 316 kB/s | 34 kB 00:00 2024-04-01T15:19:14.367 INFO:teuthology.orchestra.run.smithi142.stdout:(17/174): libradosstriper1-19.0.0-2574.gd227157 2.4 MB/s | 501 kB 00:00 2024-04-01T15:19:14.392 INFO:teuthology.orchestra.run.smithi179.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2574.gd227157 774 kB/s | 141 kB 00:00 2024-04-01T15:19:16.070 INFO:teuthology.orchestra.run.smithi142.stdout:(18/174): librgw2-19.0.0-2574.gd2271579.el9.x86 3.0 MB/s | 5.1 MB 00:01 2024-04-01T15:19:16.176 INFO:teuthology.orchestra.run.smithi142.stdout:(19/174): python3-ceph-argparse-19.0.0-2574.gd2 430 kB/s | 45 kB 00:00 2024-04-01T15:19:16.293 INFO:teuthology.orchestra.run.smithi142.stdout:(20/174): python3-ceph-common-19.0.0-2574.gd227 1.1 MB/s | 134 kB 00:00 2024-04-01T15:19:16.418 INFO:teuthology.orchestra.run.smithi142.stdout:(21/174): python3-cephfs-19.0.0-2574.gd2271579. 1.3 MB/s | 162 kB 00:00 2024-04-01T15:19:16.550 INFO:teuthology.orchestra.run.smithi179.stdout:(30/174): rbd-mirror-19.0.0-2574.gd2271579.el9. 1.1 MB/s | 3.1 MB 00:02 2024-04-01T15:19:16.560 INFO:teuthology.orchestra.run.smithi142.stdout:(22/174): python3-rados-19.0.0-2574.gd2271579.e 2.2 MB/s | 320 kB 00:00 2024-04-01T15:19:16.685 INFO:teuthology.orchestra.run.smithi142.stdout:(23/174): python3-rbd-19.0.0-2574.gd2271579.el9 2.3 MB/s | 298 kB 00:00 2024-04-01T15:19:16.810 INFO:teuthology.orchestra.run.smithi142.stdout:(24/174): python3-rgw-19.0.0-2574.gd2271579.el9 800 kB/s | 99 kB 00:00 2024-04-01T15:19:16.958 INFO:teuthology.orchestra.run.smithi142.stdout:(25/174): rbd-fuse-19.0.0-2574.gd2271579.el9.x8 585 kB/s | 85 kB 00:00 2024-04-01T15:19:17.961 INFO:teuthology.orchestra.run.smithi142.stdout:(26/174): rbd-mirror-19.0.0-2574.gd2271579.el9. 3.1 MB/s | 3.1 MB 00:01 2024-04-01T15:19:18.053 INFO:teuthology.orchestra.run.smithi142.stdout:(27/174): rbd-nbd-19.0.0-2574.gd2271579.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-01T15:19:18.145 INFO:teuthology.orchestra.run.smithi142.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2574.g 373 kB/s | 34 kB 00:00 2024-04-01T15:19:18.228 INFO:teuthology.orchestra.run.smithi142.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2574.gd227157 1.7 MB/s | 141 kB 00:00 2024-04-01T15:19:18.325 INFO:teuthology.orchestra.run.smithi179.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2574.gd2271 921 kB/s | 3.5 MB 00:03 2024-04-01T15:19:18.937 INFO:teuthology.orchestra.run.smithi142.stdout:(30/174): ceph-common-19.0.0-2574.gd2271579.el9 813 kB/s | 21 MB 00:25 2024-04-01T15:19:18.950 INFO:teuthology.orchestra.run.smithi179.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2574.gd2 399 kB/s | 249 kB 00:00 2024-04-01T15:19:19.184 INFO:teuthology.orchestra.run.smithi179.stdout:(33/174): ceph-mgr-rook-19.0.0-2574.gd2271579.e 212 kB/s | 49 kB 00:00 2024-04-01T15:19:19.284 INFO:teuthology.orchestra.run.smithi179.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2574.gd 165 kB/s | 16 kB 00:00 2024-04-01T15:19:19.454 INFO:teuthology.orchestra.run.smithi142.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2574.gd2271 2.9 MB/s | 3.5 MB 00:01 2024-04-01T15:19:19.571 INFO:teuthology.orchestra.run.smithi142.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2574.gd2 2.1 MB/s | 249 kB 00:00 2024-04-01T15:19:19.679 INFO:teuthology.orchestra.run.smithi142.stdout:(33/174): ceph-mgr-rook-19.0.0-2574.gd2271579.e 459 kB/s | 49 kB 00:00 2024-04-01T15:19:19.788 INFO:teuthology.orchestra.run.smithi142.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2574.gd 152 kB/s | 16 kB 00:00 2024-04-01T15:19:19.905 INFO:teuthology.orchestra.run.smithi142.stdout:(35/174): ceph-volume-19.0.0-2574.gd2271579.el9 2.2 MB/s | 264 kB 00:00 2024-04-01T15:19:19.960 INFO:teuthology.orchestra.run.smithi179.stdout:(35/174): ceph-volume-19.0.0-2574.gd2271579.el9 391 kB/s | 264 kB 00:00 2024-04-01T15:19:20.272 INFO:teuthology.orchestra.run.smithi142.stdout:(36/174): cephadm-19.0.0-2574.gd2271579.el9.noa 2.0 MB/s | 762 kB 00:00 2024-04-01T15:19:20.355 INFO:teuthology.orchestra.run.smithi142.stdout:(37/174): cephfs-top-19.0.0-2574.gd2271579.el9. 221 kB/s | 18 kB 00:00 2024-04-01T15:19:20.589 INFO:teuthology.orchestra.run.smithi142.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 662 kB 00:00 2024-04-01T15:19:20.706 INFO:teuthology.orchestra.run.smithi142.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 7.8 MB/s | 920 kB 00:00 2024-04-01T15:19:20.756 INFO:teuthology.orchestra.run.smithi142.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2024-04-01T15:19:20.777 INFO:teuthology.orchestra.run.smithi179.stdout:(36/174): ceph-test-19.0.0-2574.gd2271579.el9.x 2.4 MB/s | 48 MB 00:19 2024-04-01T15:19:20.806 INFO:teuthology.orchestra.run.smithi142.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2024-04-01T15:19:20.865 INFO:teuthology.orchestra.run.smithi142.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 545 kB/s | 32 kB 00:00 2024-04-01T15:19:20.877 INFO:teuthology.orchestra.run.smithi179.stdout:(37/174): cephfs-top-19.0.0-2574.gd2271579.el9. 184 kB/s | 18 kB 00:00 2024-04-01T15:19:21.001 INFO:teuthology.orchestra.run.smithi142.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-04-01T15:19:21.035 INFO:teuthology.orchestra.run.smithi142.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 529 kB/s | 17 kB 00:00 2024-04-01T15:19:21.068 INFO:teuthology.orchestra.run.smithi142.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 309 kB/s | 10 kB 00:00 2024-04-01T15:19:21.077 INFO:teuthology.orchestra.run.smithi179.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 662 kB 00:00 2024-04-01T15:19:21.110 INFO:teuthology.orchestra.run.smithi142.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2024-04-01T15:19:21.144 INFO:teuthology.orchestra.run.smithi142.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-01T15:19:21.144 INFO:teuthology.orchestra.run.smithi179.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2024-04-01T15:19:21.186 INFO:teuthology.orchestra.run.smithi179.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-04-01T15:19:21.202 INFO:teuthology.orchestra.run.smithi142.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-04-01T15:19:21.236 INFO:teuthology.orchestra.run.smithi179.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2024-04-01T15:19:21.269 INFO:teuthology.orchestra.run.smithi142.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2024-04-01T15:19:21.270 INFO:teuthology.orchestra.run.smithi179.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 971 kB/s | 32 kB 00:00 2024-04-01T15:19:21.328 INFO:teuthology.orchestra.run.smithi142.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 807 kB/s | 46 kB 00:00 2024-04-01T15:19:21.387 INFO:teuthology.orchestra.run.smithi142.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-04-01T15:19:21.404 INFO:teuthology.orchestra.run.smithi179.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 23 MB/s | 3.0 MB 00:00 2024-04-01T15:19:21.429 INFO:teuthology.orchestra.run.smithi142.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-04-01T15:19:21.437 INFO:teuthology.orchestra.run.smithi179.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 528 kB/s | 17 kB 00:00 2024-04-01T15:19:21.470 INFO:teuthology.orchestra.run.smithi142.stdout:(53/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2024-04-01T15:19:21.479 INFO:teuthology.orchestra.run.smithi179.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 245 kB/s | 10 kB 00:00 2024-04-01T15:19:21.504 INFO:teuthology.orchestra.run.smithi142.stdout:(54/174): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-04-01T15:19:21.521 INFO:teuthology.orchestra.run.smithi179.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2024-04-01T15:19:21.571 INFO:teuthology.orchestra.run.smithi179.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 892 kB/s | 44 kB 00:00 2024-04-01T15:19:21.646 INFO:teuthology.orchestra.run.smithi179.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2024-04-01T15:19:21.688 INFO:teuthology.orchestra.run.smithi142.stdout:(55/174): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-04-01T15:19:21.697 INFO:teuthology.orchestra.run.smithi179.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-04-01T15:19:21.756 INFO:teuthology.orchestra.run.smithi179.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 806 kB/s | 46 kB 00:00 2024-04-01T15:19:21.771 INFO:teuthology.orchestra.run.smithi142.stdout:(56/174): postgresql-13.14-1.el9.x86_64.rpm 19 MB/s | 1.5 MB 00:00 2024-04-01T15:19:21.806 INFO:teuthology.orchestra.run.smithi179.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2024-04-01T15:19:21.830 INFO:teuthology.orchestra.run.smithi142.stdout:(57/174): postgresql-contrib-13.14-1.el9.x86_64 14 MB/s | 817 kB 00:00 2024-04-01T15:19:21.848 INFO:teuthology.orchestra.run.smithi179.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-04-01T15:19:21.872 INFO:teuthology.orchestra.run.smithi142.stdout:(58/174): postgresql-private-libs-13.14-1.el9.x 3.1 MB/s | 132 kB 00:00 2024-04-01T15:19:21.981 INFO:teuthology.orchestra.run.smithi179.stdout:(53/174): ceph-mgr-diskprediction-local-19.0.0- 1.4 MB/s | 7.4 MB 00:05 2024-04-01T15:19:22.007 INFO:teuthology.orchestra.run.smithi179.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2024-04-01T15:19:22.064 INFO:teuthology.orchestra.run.smithi142.stdout:(59/174): postgresql-server-13.14-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2024-04-01T15:19:22.065 INFO:teuthology.orchestra.run.smithi179.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 421 kB/s | 34 kB 00:00 2024-04-01T15:19:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:(56/174): cephadm-19.0.0-2574.gd2271579.el9.noa 354 kB/s | 762 kB 00:02 2024-04-01T15:19:22.147 INFO:teuthology.orchestra.run.smithi142.stdout:(60/174): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-01T15:19:22.206 INFO:teuthology.orchestra.run.smithi142.stdout:(61/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-04-01T15:19:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-04-01T15:19:22.300 INFO:teuthology.orchestra.run.smithi179.stdout:(58/174): postgresql-13.14-1.el9.x86_64.rpm 7.0 MB/s | 1.5 MB 00:00 2024-04-01T15:19:22.342 INFO:teuthology.orchestra.run.smithi179.stdout:(59/174): postgresql-contrib-13.14-1.el9.x86_64 3.8 MB/s | 817 kB 00:00 2024-04-01T15:19:22.367 INFO:teuthology.orchestra.run.smithi179.stdout:(60/174): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 132 kB 00:00 2024-04-01T15:19:22.406 INFO:teuthology.orchestra.run.smithi142.stdout:(62/174): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 5.8 MB 00:00 2024-04-01T15:19:22.473 INFO:teuthology.orchestra.run.smithi142.stdout:(63/174): python3-jsonpatch-1.21-16.el9.noarch. 371 kB/s | 24 kB 00:00 2024-04-01T15:19:22.475 INFO:teuthology.orchestra.run.smithi179.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 7.7 MB/s | 1.0 MB 00:00 2024-04-01T15:19:22.524 INFO:teuthology.orchestra.run.smithi142.stdout:(64/174): python3-jsonpointer-2.0-4.el9.noarch. 367 kB/s | 18 kB 00:00 2024-04-01T15:19:22.574 INFO:teuthology.orchestra.run.smithi142.stdout:(65/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2024-04-01T15:19:22.592 INFO:teuthology.orchestra.run.smithi179.stdout:(62/174): postgresql-server-13.14-1.el9.x86_64. 23 MB/s | 5.7 MB 00:00 2024-04-01T15:19:22.617 INFO:teuthology.orchestra.run.smithi179.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 311 kB/s | 78 kB 00:00 2024-04-01T15:19:22.641 INFO:teuthology.orchestra.run.smithi142.stdout:(66/174): python3-markupsafe-1.1.1-12.el9.x86_6 479 kB/s | 32 kB 00:00 2024-04-01T15:19:22.785 INFO:teuthology.orchestra.run.smithi179.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-04-01T15:19:22.801 INFO:teuthology.orchestra.run.smithi179.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 143 kB/s | 24 kB 00:00 2024-04-01T15:19:22.818 INFO:teuthology.orchestra.run.smithi179.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 97 kB/s | 18 kB 00:00 2024-04-01T15:19:22.843 INFO:teuthology.orchestra.run.smithi179.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-04-01T15:19:22.858 INFO:teuthology.orchestra.run.smithi142.stdout:(67/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2024-04-01T15:19:22.877 INFO:teuthology.orchestra.run.smithi179.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 562 kB/s | 32 kB 00:00 2024-04-01T15:19:22.950 INFO:teuthology.orchestra.run.smithi142.stdout:(68/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 217 kB 00:00 2024-04-01T15:19:23.025 INFO:teuthology.orchestra.run.smithi142.stdout:(69/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 174 kB 00:00 2024-04-01T15:19:23.035 INFO:teuthology.orchestra.run.smithi179.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2024-04-01T15:19:23.069 INFO:teuthology.orchestra.run.smithi179.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 966 kB/s | 217 kB 00:00 2024-04-01T15:19:23.076 INFO:teuthology.orchestra.run.smithi142.stdout:(70/174): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 69 kB 00:00 2024-04-01T15:19:23.094 INFO:teuthology.orchestra.run.smithi179.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 850 kB/s | 174 kB 00:00 2024-04-01T15:19:23.118 INFO:teuthology.orchestra.run.smithi142.stdout:(71/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-04-01T15:19:23.120 INFO:teuthology.orchestra.run.smithi179.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 856 kB/s | 69 kB 00:00 2024-04-01T15:19:23.145 INFO:teuthology.orchestra.run.smithi179.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 849 kB/s | 41 kB 00:00 2024-04-01T15:19:23.170 INFO:teuthology.orchestra.run.smithi179.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 238 kB 00:00 2024-04-01T15:19:23.176 INFO:teuthology.orchestra.run.smithi142.stdout:(72/174): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-04-01T15:19:23.195 INFO:teuthology.orchestra.run.smithi179.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-01T15:19:23.221 INFO:teuthology.orchestra.run.smithi179.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 986 kB/s | 47 kB 00:00 2024-04-01T15:19:23.226 INFO:teuthology.orchestra.run.smithi142.stdout:(73/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-04-01T15:19:23.254 INFO:teuthology.orchestra.run.smithi179.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2024-04-01T15:19:23.279 INFO:teuthology.orchestra.run.smithi179.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 517 kB/s | 43 kB 00:00 2024-04-01T15:19:23.285 INFO:teuthology.orchestra.run.smithi142.stdout:(74/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-04-01T15:19:23.344 INFO:teuthology.orchestra.run.smithi142.stdout:(75/174): python3-pytz-2021.1-5.el9.noarch.rpm 816 kB/s | 47 kB 00:00 2024-04-01T15:19:23.411 INFO:teuthology.orchestra.run.smithi142.stdout:(76/174): python3-requests-oauthlib-1.3.0-12.el 650 kB/s | 43 kB 00:00 2024-04-01T15:19:23.580 INFO:teuthology.orchestra.run.smithi179.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 135 kB/s | 39 kB 00:00 2024-04-01T15:19:23.596 INFO:teuthology.orchestra.run.smithi179.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 135 kB/s | 41 kB 00:00 2024-04-01T15:19:23.905 INFO:teuthology.orchestra.run.smithi179.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-04-01T15:19:23.930 INFO:teuthology.orchestra.run.smithi179.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 109 kB/s | 35 kB 00:00 2024-04-01T15:19:23.963 INFO:teuthology.orchestra.run.smithi179.stdout:(83/174): qatlib-24.02.0-1.el9.x86_64.rpm 622 kB/s | 220 kB 00:00 2024-04-01T15:19:23.997 INFO:teuthology.orchestra.run.smithi179.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.6 MB/s | 300 kB 00:00 2024-04-01T15:19:24.022 INFO:teuthology.orchestra.run.smithi179.stdout:(85/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 517 kB/s | 46 kB 00:00 2024-04-01T15:19:24.048 INFO:teuthology.orchestra.run.smithi179.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 683 kB/s | 56 kB 00:00 2024-04-01T15:19:24.073 INFO:teuthology.orchestra.run.smithi179.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 832 kB/s | 63 kB 00:00 2024-04-01T15:19:24.099 INFO:teuthology.orchestra.run.smithi179.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 589 kB/s | 44 kB 00:00 2024-04-01T15:19:24.124 INFO:teuthology.orchestra.run.smithi179.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-04-01T15:19:24.158 INFO:teuthology.orchestra.run.smithi179.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-04-01T15:19:24.216 INFO:teuthology.orchestra.run.smithi179.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 9.9 MB/s | 1.1 MB 00:00 2024-04-01T15:19:24.241 INFO:teuthology.orchestra.run.smithi179.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 899 kB/s | 103 kB 00:00 2024-04-01T15:19:24.350 INFO:teuthology.orchestra.run.smithi179.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 680 kB/s | 124 kB 00:00 2024-04-01T15:19:24.384 INFO:teuthology.orchestra.run.smithi179.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 1.1 MB/s | 187 kB 00:00 2024-04-01T15:19:24.595 INFO:teuthology.orchestra.run.smithi142.stdout:(77/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-04-01T15:19:24.609 INFO:teuthology.orchestra.run.smithi179.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 732 kB/s | 187 kB 00:00 2024-04-01T15:19:24.634 INFO:teuthology.orchestra.run.smithi179.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 782 kB/s | 195 kB 00:00 2024-04-01T15:19:24.636 INFO:teuthology.orchestra.run.smithi142.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 955 kB/s | 39 kB 00:00 2024-04-01T15:19:24.679 INFO:teuthology.orchestra.run.smithi142.stdout:(79/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 41 kB 00:00 2024-04-01T15:19:24.684 INFO:teuthology.orchestra.run.smithi179.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-01T15:19:24.718 INFO:teuthology.orchestra.run.smithi179.stdout:(98/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-04-01T15:19:24.728 INFO:teuthology.orchestra.run.smithi142.stdout:(80/174): qatlib-24.02.0-1.el9.x86_64.rpm 4.4 MB/s | 220 kB 00:00 2024-04-01T15:19:24.770 INFO:teuthology.orchestra.run.smithi142.stdout:(81/174): qatlib-service-24.02.0-1.el9.x86_64.r 846 kB/s | 35 kB 00:00 2024-04-01T15:19:24.818 INFO:teuthology.orchestra.run.smithi179.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 192 kB/s | 25 kB 00:00 2024-04-01T15:19:24.829 INFO:teuthology.orchestra.run.smithi142.stdout:(82/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 803 kB/s | 46 kB 00:00 2024-04-01T15:19:24.835 INFO:teuthology.orchestra.run.smithi179.stdout:(100/174): elfutils-libelf-devel-0.190-2.el9.x8 107 kB/s | 21 kB 00:00 2024-04-01T15:19:24.921 INFO:teuthology.orchestra.run.smithi142.stdout:(83/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 300 kB 00:00 2024-04-01T15:19:24.988 INFO:teuthology.orchestra.run.smithi142.stdout:(84/174): uuid-1.6.2-55.el9.x86_64.rpm 857 kB/s | 56 kB 00:00 2024-04-01T15:19:25.072 INFO:teuthology.orchestra.run.smithi142.stdout:(85/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 757 kB/s | 63 kB 00:00 2024-04-01T15:19:25.111 INFO:teuthology.orchestra.run.smithi179.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 843 kB/s | 245 kB 00:00 2024-04-01T15:19:25.147 INFO:teuthology.orchestra.run.smithi142.stdout:(86/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 594 kB/s | 44 kB 00:00 2024-04-01T15:19:25.194 INFO:teuthology.orchestra.run.smithi179.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.1 MB/s | 94 kB 00:00 2024-04-01T15:19:25.245 INFO:teuthology.orchestra.run.smithi179.stdout:(103/174): python3-jinja2-2.11.3-5.el9.noarch.r 607 kB/s | 248 kB 00:00 2024-04-01T15:19:25.257 INFO:teuthology.orchestra.run.smithi142.stdout:(87/174): fuse-2.9.9-15.el9.x86_64.rpm 722 kB/s | 79 kB 00:00 2024-04-01T15:19:25.348 INFO:teuthology.orchestra.run.smithi142.stdout:(88/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-04-01T15:19:25.532 INFO:teuthology.orchestra.run.smithi142.stdout:(89/174): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.1 MB 00:00 2024-04-01T15:19:25.536 INFO:teuthology.orchestra.run.smithi179.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 65 kB/s | 22 kB 00:00 2024-04-01T15:19:25.581 INFO:teuthology.orchestra.run.smithi142.stdout:(90/174): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 103 kB 00:00 2024-04-01T15:19:25.632 INFO:teuthology.orchestra.run.smithi142.stdout:(91/174): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-04-01T15:19:25.715 INFO:teuthology.orchestra.run.smithi142.stdout:(92/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2024-04-01T15:19:25.837 INFO:teuthology.orchestra.run.smithi179.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-04-01T15:19:25.897 INFO:teuthology.orchestra.run.smithi179.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 5.3 MB/s | 309 kB 00:00 2024-04-01T15:19:25.971 INFO:teuthology.orchestra.run.smithi179.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 262 kB/s | 19 kB 00:00 2024-04-01T15:19:26.008 INFO:teuthology.orchestra.run.smithi142.stdout:(93/174): jq-1.6-16.el9.x86_64.rpm 644 kB/s | 187 kB 00:00 2024-04-01T15:19:26.021 INFO:teuthology.orchestra.run.smithi179.stdout:(108/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-04-01T15:19:26.166 INFO:teuthology.orchestra.run.smithi142.stdout:(94/174): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 803 kB 00:00 2024-04-01T15:19:26.179 INFO:teuthology.orchestra.run.smithi179.stdout:(109/174): libarrow-9.0.0-10.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-04-01T15:19:26.204 INFO:teuthology.orchestra.run.smithi179.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 154 kB/s | 26 kB 00:00 2024-04-01T15:19:26.233 INFO:teuthology.orchestra.run.smithi142.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-04-01T15:19:26.255 INFO:teuthology.orchestra.run.smithi179.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 997 kB/s | 49 kB 00:00 2024-04-01T15:19:26.280 INFO:teuthology.orchestra.run.smithi179.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 914 kB/s | 67 kB 00:00 2024-04-01T15:19:26.300 INFO:teuthology.orchestra.run.smithi142.stdout:(96/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-01T15:19:26.347 INFO:teuthology.orchestra.run.smithi179.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-04-01T15:19:26.367 INFO:teuthology.orchestra.run.smithi142.stdout:(97/174): elfutils-libelf-devel-0.190-2.el9.x86 327 kB/s | 21 kB 00:00 2024-04-01T15:19:26.380 INFO:teuthology.orchestra.run.smithi179.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.3 MB/s | 838 kB 00:00 2024-04-01T15:19:26.434 INFO:teuthology.orchestra.run.smithi142.stdout:(98/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 387 kB/s | 25 kB 00:00 2024-04-01T15:19:26.472 INFO:teuthology.orchestra.run.smithi179.stdout:(115/174): openssl-devel-3.0.7-27.el9.x86_64.rp 2.4 MB/s | 4.1 MB 00:01 2024-04-01T15:19:26.506 INFO:teuthology.orchestra.run.smithi179.stdout:(116/174): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-01T15:19:26.531 INFO:teuthology.orchestra.run.smithi179.stdout:(117/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 291 kB/s | 43 kB 00:00 2024-04-01T15:19:26.556 INFO:teuthology.orchestra.run.smithi179.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 412 kB/s | 32 kB 00:00 2024-04-01T15:19:26.581 INFO:teuthology.orchestra.run.smithi179.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 307 kB/s | 15 kB 00:00 2024-04-01T15:19:26.615 INFO:teuthology.orchestra.run.smithi179.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-01T15:19:26.657 INFO:teuthology.orchestra.run.smithi179.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.6 MB/s | 358 kB 00:00 2024-04-01T15:19:26.699 INFO:teuthology.orchestra.run.smithi179.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.7 MB/s | 303 kB 00:00 2024-04-01T15:19:26.724 INFO:teuthology.orchestra.run.smithi179.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 338 kB/s | 35 kB 00:00 2024-04-01T15:19:26.750 INFO:teuthology.orchestra.run.smithi179.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-04-01T15:19:26.976 INFO:teuthology.orchestra.run.smithi142.stdout:(99/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 7.6 MB/s | 4.1 MB 00:00 2024-04-01T15:19:27.135 INFO:teuthology.orchestra.run.smithi142.stdout:(100/174): ceph-mgr-diskprediction-local-19.0.0 922 kB/s | 7.4 MB 00:08 2024-04-01T15:19:27.175 INFO:teuthology.orchestra.run.smithi179.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 4.6 MB/s | 2.0 MB 00:00 2024-04-01T15:19:27.200 INFO:teuthology.orchestra.run.smithi179.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 306 kB/s | 144 kB 00:00 2024-04-01T15:19:27.242 INFO:teuthology.orchestra.run.smithi179.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 22 kB/s | 11 kB 00:00 2024-04-01T15:19:27.267 INFO:teuthology.orchestra.run.smithi179.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 196 kB/s | 18 kB 00:00 2024-04-01T15:19:27.293 INFO:teuthology.orchestra.run.smithi179.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 473 kB/s | 23 kB 00:00 2024-04-01T15:19:27.309 INFO:teuthology.orchestra.run.smithi179.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 297 kB/s | 19 kB 00:00 2024-04-01T15:19:27.310 INFO:teuthology.orchestra.run.smithi142.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 737 kB/s | 245 kB 00:00 2024-04-01T15:19:27.326 INFO:teuthology.orchestra.run.smithi179.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 338 kB/s | 20 kB 00:00 2024-04-01T15:19:27.385 INFO:teuthology.orchestra.run.smithi179.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-04-01T15:19:27.386 INFO:teuthology.orchestra.run.smithi142.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.3 MB/s | 94 kB 00:00 2024-04-01T15:19:27.402 INFO:teuthology.orchestra.run.smithi179.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 511 kB/s | 46 kB 00:00 2024-04-01T15:19:27.435 INFO:teuthology.orchestra.run.smithi179.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 728 kB/s | 79 kB 00:00 2024-04-01T15:19:27.452 INFO:teuthology.orchestra.run.smithi179.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 1.2 MB/s | 58 kB 00:00 2024-04-01T15:19:27.469 INFO:teuthology.orchestra.run.smithi142.stdout:(103/174): python3-jinja2-2.11.3-5.el9.noarch.r 745 kB/s | 248 kB 00:00 2024-04-01T15:19:27.478 INFO:teuthology.orchestra.run.smithi179.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-04-01T15:19:27.494 INFO:teuthology.orchestra.run.smithi179.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 298 kB/s | 16 kB 00:00 2024-04-01T15:19:27.519 INFO:teuthology.orchestra.run.smithi142.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 168 kB/s | 22 kB 00:00 2024-04-01T15:19:27.520 INFO:teuthology.orchestra.run.smithi179.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 699 kB/s | 28 kB 00:00 2024-04-01T15:19:27.545 INFO:teuthology.orchestra.run.smithi179.stdout:(139/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-01T15:19:27.562 INFO:teuthology.orchestra.run.smithi179.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 462 kB/s | 31 kB 00:00 2024-04-01T15:19:27.595 INFO:teuthology.orchestra.run.smithi179.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-01T15:19:27.612 INFO:teuthology.orchestra.run.smithi179.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 753 kB/s | 36 kB 00:00 2024-04-01T15:19:27.629 INFO:teuthology.orchestra.run.smithi179.stdout:(143/174): python3-rsa-4.9-2.el9.noarch.rpm 915 kB/s | 59 kB 00:00 2024-04-01T15:19:27.654 INFO:teuthology.orchestra.run.smithi179.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 883 kB/s | 51 kB 00:00 2024-04-01T15:19:27.688 INFO:teuthology.orchestra.run.smithi179.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-01T15:19:27.722 INFO:teuthology.orchestra.run.smithi179.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 985 kB/s | 90 kB 00:00 2024-04-01T15:19:27.755 INFO:teuthology.orchestra.run.smithi179.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.3 MB/s | 427 kB 00:00 2024-04-01T15:19:27.780 INFO:teuthology.orchestra.run.smithi179.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 231 kB/s | 20 kB 00:00 2024-04-01T15:19:27.831 INFO:teuthology.orchestra.run.smithi179.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-01T15:19:27.889 INFO:teuthology.orchestra.run.smithi179.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-01T15:19:27.903 INFO:teuthology.orchestra.run.smithi142.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-04-01T15:19:28.048 INFO:teuthology.orchestra.run.smithi179.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-04-01T15:19:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 844 kB/s | 548 kB 00:00 2024-04-01T15:19:28.190 INFO:teuthology.orchestra.run.smithi179.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-04-01T15:19:28.240 INFO:teuthology.orchestra.run.smithi179.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 833 kB/s | 41 kB 00:00 2024-04-01T15:19:28.278 INFO:teuthology.orchestra.run.smithi142.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 181 kB/s | 19 kB 00:00 2024-04-01T15:19:28.299 INFO:teuthology.orchestra.run.smithi179.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 4.2 MB/s | 247 kB 00:00 2024-04-01T15:19:28.329 INFO:teuthology.orchestra.run.smithi142.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 727 kB/s | 309 kB 00:00 2024-04-01T15:19:28.357 INFO:teuthology.orchestra.run.smithi179.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2024-04-01T15:19:28.429 INFO:teuthology.orchestra.run.smithi142.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 262 kB/s | 26 kB 00:00 2024-04-01T15:19:28.449 INFO:teuthology.orchestra.run.smithi179.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 785 kB/s | 71 kB 00:00 2024-04-01T15:19:28.504 INFO:teuthology.orchestra.run.smithi142.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 653 kB/s | 49 kB 00:00 2024-04-01T15:19:28.525 INFO:teuthology.orchestra.run.smithi179.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 491 kB/s | 36 kB 00:00 2024-04-01T15:19:28.580 INFO:teuthology.orchestra.run.smithi142.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 908 kB/s | 67 kB 00:00 2024-04-01T15:19:28.608 INFO:teuthology.orchestra.run.smithi179.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-04-01T15:19:28.675 INFO:teuthology.orchestra.run.smithi179.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.8 MB/s | 256 kB 00:00 2024-04-01T15:19:28.734 INFO:teuthology.orchestra.run.smithi179.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 399 kB/s | 23 kB 00:00 2024-04-01T15:19:28.763 INFO:teuthology.orchestra.run.smithi142.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 829 kB/s | 151 kB 00:00 2024-04-01T15:19:28.792 INFO:teuthology.orchestra.run.smithi179.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-04-01T15:19:28.851 INFO:teuthology.orchestra.run.smithi179.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-04-01T15:19:28.927 INFO:teuthology.orchestra.run.smithi179.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 136 kB 00:00 2024-04-01T15:19:28.947 INFO:teuthology.orchestra.run.smithi142.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-04-01T15:19:28.985 INFO:teuthology.orchestra.run.smithi179.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-04-01T15:19:29.044 INFO:teuthology.orchestra.run.smithi179.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 499 kB/s | 29 kB 00:00 2024-04-01T15:19:29.097 INFO:teuthology.orchestra.run.smithi142.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-04-01T15:19:29.185 INFO:teuthology.orchestra.run.smithi179.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 8.6 MB/s | 1.2 MB 00:00 2024-04-01T15:19:29.198 INFO:teuthology.orchestra.run.smithi142.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 432 kB/s | 43 kB 00:00 2024-04-01T15:19:29.306 INFO:teuthology.orchestra.run.smithi142.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 303 kB/s | 32 kB 00:00 2024-04-01T15:19:29.398 INFO:teuthology.orchestra.run.smithi142.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2024-04-01T15:19:29.477 INFO:teuthology.orchestra.run.smithi179.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.4 MB/s | 2.2 MB 00:00 2024-04-01T15:19:29.532 INFO:teuthology.orchestra.run.smithi142.stdout:(118/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-04-01T15:19:29.673 INFO:teuthology.orchestra.run.smithi142.stdout:(119/174): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-04-01T15:19:29.678 INFO:teuthology.orchestra.run.smithi179.stdout:(168/174): librados2-19.0.0-2574.gd2271579.el9. 1.8 MB/s | 3.4 MB 00:01 2024-04-01T15:19:29.774 INFO:teuthology.orchestra.run.smithi142.stdout:(120/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 4.4 MB 00:01 2024-04-01T15:19:29.792 INFO:teuthology.orchestra.run.smithi179.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 7.3 MB/s | 2.3 MB 00:00 2024-04-01T15:19:29.807 INFO:teuthology.orchestra.run.smithi142.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-04-01T15:19:29.828 INFO:teuthology.orchestra.run.smithi179.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 3.0 MB/s | 465 kB 00:00 2024-04-01T15:19:29.845 INFO:teuthology.orchestra.run.smithi179.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 608 kB/s | 31 kB 00:00 2024-04-01T15:19:29.874 INFO:teuthology.orchestra.run.smithi142.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 355 kB/s | 35 kB 00:00 2024-04-01T15:19:29.908 INFO:teuthology.orchestra.run.smithi142.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-04-01T15:19:29.987 INFO:teuthology.orchestra.run.smithi179.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.8 MB/s | 1.1 MB 00:00 2024-04-01T15:19:30.017 INFO:teuthology.orchestra.run.smithi179.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 435 kB/s | 74 kB 00:00 2024-04-01T15:19:30.025 INFO:teuthology.orchestra.run.smithi142.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-04-01T15:19:30.109 INFO:teuthology.orchestra.run.smithi142.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2024-04-01T15:19:30.209 INFO:teuthology.orchestra.run.smithi142.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 178 kB/s | 18 kB 00:00 2024-04-01T15:19:30.284 INFO:teuthology.orchestra.run.smithi142.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 5.0 MB/s | 2.0 MB 00:00 2024-04-01T15:19:30.312 INFO:teuthology.orchestra.run.smithi142.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 227 kB/s | 23 kB 00:00 2024-04-01T15:19:30.371 INFO:teuthology.orchestra.run.smithi142.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 228 kB/s | 19 kB 00:00 2024-04-01T15:19:30.396 INFO:teuthology.orchestra.run.smithi142.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 237 kB/s | 20 kB 00:00 2024-04-01T15:19:30.514 INFO:teuthology.orchestra.run.smithi142.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 398 kB/s | 46 kB 00:00 2024-04-01T15:19:30.597 INFO:teuthology.orchestra.run.smithi142.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-04-01T15:19:30.622 INFO:teuthology.orchestra.run.smithi142.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 732 kB/s | 79 kB 00:00 2024-04-01T15:19:30.673 INFO:teuthology.orchestra.run.smithi142.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 775 kB/s | 58 kB 00:00 2024-04-01T15:19:30.731 INFO:teuthology.orchestra.run.smithi142.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-04-01T15:19:30.756 INFO:teuthology.orchestra.run.smithi142.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2024-04-01T15:19:30.873 INFO:teuthology.orchestra.run.smithi142.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 637 kB/s | 90 kB 00:00 2024-04-01T15:19:30.899 INFO:teuthology.orchestra.run.smithi142.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 200 kB/s | 28 kB 00:00 2024-04-01T15:19:30.957 INFO:teuthology.orchestra.run.smithi142.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 372 kB/s | 31 kB 00:00 2024-04-01T15:19:30.999 INFO:teuthology.orchestra.run.smithi142.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-01T15:19:31.066 INFO:teuthology.orchestra.run.smithi142.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 548 kB/s | 59 kB 00:00 2024-04-01T15:19:31.125 INFO:teuthology.orchestra.run.smithi142.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 287 kB/s | 36 kB 00:00 2024-04-01T15:19:31.158 INFO:teuthology.orchestra.run.smithi142.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 557 kB/s | 51 kB 00:00 2024-04-01T15:19:31.242 INFO:teuthology.orchestra.run.smithi142.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-01T15:19:31.259 INFO:teuthology.orchestra.run.smithi142.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 900 kB/s | 90 kB 00:00 2024-04-01T15:19:31.393 INFO:teuthology.orchestra.run.smithi142.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-04-01T15:19:31.418 INFO:teuthology.orchestra.run.smithi142.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 126 kB/s | 20 kB 00:00 2024-04-01T15:19:31.493 INFO:teuthology.orchestra.run.smithi142.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-01T15:19:31.610 INFO:teuthology.orchestra.run.smithi142.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-04-01T15:19:32.617 INFO:teuthology.orchestra.run.smithi179.stdout:(174/174): librbd1-19.0.0-2574.gd2271579.el9.x8 673 kB/s | 3.1 MB 00:04 2024-04-01T15:19:32.627 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-04-01T15:19:32.627 INFO:teuthology.orchestra.run.smithi179.stdout:Total 5.6 MB/s | 226 MB 00:40 2024-04-01T15:19:32.952 INFO:teuthology.orchestra.run.smithi142.stdout:(150/174): ceph-test-19.0.0-2574.gd2271579.el9. 1.8 MB/s | 48 MB 00:26 2024-04-01T15:19:33.153 INFO:teuthology.orchestra.run.smithi142.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-04-01T15:19:33.294 INFO:teuthology.orchestra.run.smithi142.stdout:(152/174): librados2-19.0.0-2574.gd2271579.el9. 1.9 MB/s | 3.4 MB 00:01 2024-04-01T15:19:33.353 INFO:teuthology.orchestra.run.smithi142.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 9.1 MB/s | 1.8 MB 00:00 2024-04-01T15:19:33.370 INFO:teuthology.orchestra.run.smithi142.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 578 kB/s | 41 kB 00:00 2024-04-01T15:19:33.404 INFO:teuthology.orchestra.run.smithi142.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 4.9 MB/s | 247 kB 00:00 2024-04-01T15:19:33.446 INFO:teuthology.orchestra.run.smithi142.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.3 MB/s | 321 kB 00:00 2024-04-01T15:19:33.705 INFO:teuthology.orchestra.run.smithi142.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 141 kB/s | 36 kB 00:00 2024-04-01T15:19:33.730 INFO:teuthology.orchestra.run.smithi142.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 221 kB/s | 71 kB 00:00 2024-04-01T15:19:33.750 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-04-01T15:19:33.813 INFO:teuthology.orchestra.run.smithi142.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2024-04-01T15:19:33.855 INFO:teuthology.orchestra.run.smithi142.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.0 MB/s | 256 kB 00:00 2024-04-01T15:19:33.889 INFO:teuthology.orchestra.run.smithi142.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 310 kB/s | 23 kB 00:00 2024-04-01T15:19:33.923 INFO:teuthology.orchestra.run.smithi142.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-04-01T15:19:33.998 INFO:teuthology.orchestra.run.smithi142.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 155 kB 00:00 2024-04-01T15:19:34.040 INFO:teuthology.orchestra.run.smithi142.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-04-01T15:19:34.082 INFO:teuthology.orchestra.run.smithi142.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 771 kB/s | 64 kB 00:00 2024-04-01T15:19:34.099 INFO:teuthology.orchestra.run.smithi142.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 497 kB/s | 29 kB 00:00 2024-04-01T15:19:34.125 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-04-01T15:19:34.125 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-04-01T15:19:34.207 INFO:teuthology.orchestra.run.smithi142.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-04-01T15:19:34.291 INFO:teuthology.orchestra.run.smithi142.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2024-04-01T15:19:34.375 INFO:teuthology.orchestra.run.smithi142.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.5 MB/s | 465 kB 00:00 2024-04-01T15:19:34.450 INFO:teuthology.orchestra.run.smithi142.stdout:(170/174): util-linux-2.37.4-18.el9.x86_64.rpm 9.5 MB/s | 2.3 MB 00:00 2024-04-01T15:19:34.534 INFO:teuthology.orchestra.run.smithi142.stdout:(171/174): librbd1-19.0.0-2574.gd2271579.el9.x8 1.1 MB/s | 3.1 MB 00:02 2024-04-01T15:19:34.559 INFO:teuthology.orchestra.run.smithi142.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 170 kB/s | 31 kB 00:00 2024-04-01T15:19:34.634 INFO:teuthology.orchestra.run.smithi142.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.9 MB/s | 1.1 MB 00:00 2024-04-01T15:19:34.659 INFO:teuthology.orchestra.run.smithi142.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 598 kB/s | 74 kB 00:00 2024-04-01T15:19:34.673 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-01T15:19:34.673 INFO:teuthology.orchestra.run.smithi142.stdout:Total 5.3 MB/s | 226 MB 00:42 2024-04-01T15:19:35.817 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-01T15:19:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-01T15:19:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-01T15:19:36.514 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-04-01T15:19:36.514 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-04-01T15:19:38.531 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-01T15:19:38.531 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-01T15:19:43.663 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-04-01T15:19:43.767 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-01T15:19:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-01T15:19:43.883 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-01T15:19:43.928 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-01T15:19:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-01T15:19:44.121 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-01T15:19:44.177 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-01T15:19:44.209 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-01T15:19:44.285 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-01T15:19:44.696 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-01T15:19:44.741 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-04-01T15:19:44.873 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-04-01T15:19:44.900 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-04-01T15:19:45.025 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-04-01T15:19:45.057 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 12/198 2024-04-01T15:19:45.122 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-01T15:19:45.432 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-01T15:19:45.488 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-01T15:19:45.517 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-04-01T15:19:45.703 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-04-01T15:19:45.735 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 17/198 2024-04-01T15:19:45.858 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 17/198 2024-04-01T15:19:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-01T15:19:45.911 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-01T15:19:45.945 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-01T15:19:45.978 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-01T15:19:46.005 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-01T15:19:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-01T15:19:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-01T15:19:46.113 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-01T15:19:46.200 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-01T15:19:46.301 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-01T15:19:46.313 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-01T15:19:46.354 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-01T15:19:46.370 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-01T15:19:46.395 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-01T15:19:46.402 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-01T15:19:46.487 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-01T15:19:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-01T15:19:46.861 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-04-01T15:19:46.906 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-01T15:19:46.942 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-04-01T15:19:46.958 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-04-01T15:19:47.131 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-04-01T15:19:47.146 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-01T15:19:47.167 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-04-01T15:19:47.197 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-01T15:19:47.290 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-04-01T15:19:47.324 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 12/198 2024-04-01T15:19:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-01T15:19:47.548 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-01T15:19:47.679 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-01T15:19:47.734 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-01T15:19:47.738 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-01T15:19:47.764 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-04-01T15:19:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-01T15:19:47.894 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-04-01T15:19:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-01T15:19:47.940 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-01T15:19:47.948 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 17/198 2024-04-01T15:19:48.003 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-01T15:19:48.039 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 17/198 2024-04-01T15:19:48.084 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-01T15:19:48.117 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-01T15:19:48.122 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-01T15:19:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-01T15:19:48.185 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-01T15:19:48.227 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-01T15:19:48.307 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-01T15:19:48.349 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-01T15:19:48.407 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-01T15:19:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-01T15:19:48.452 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-01T15:19:48.486 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-01T15:19:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-01T15:19:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-01T15:19:48.596 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-01T15:19:48.631 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 39/198 2024-04-01T15:19:48.680 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 40/198 2024-04-01T15:19:48.713 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 41/198 2024-04-01T15:19:48.826 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-01T15:19:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-01T15:19:48.884 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-01T15:19:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-01T15:19:49.041 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-04-01T15:19:49.129 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-04-01T15:19:49.159 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-01T15:19:49.219 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-01T15:19:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-01T15:19:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-01T15:19:49.768 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-01T15:19:49.899 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-01T15:19:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-01T15:19:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-01T15:19:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-01T15:19:50.170 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-01T15:19:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-01T15:19:50.339 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-01T15:19:50.398 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-01T15:19:50.441 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-01T15:19:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-01T15:19:50.530 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-01T15:19:50.580 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-01T15:19:50.642 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-01T15:19:50.661 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-01T15:19:50.685 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-01T15:19:50.716 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-01T15:19:50.726 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-01T15:19:50.754 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-01T15:19:50.806 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-01T15:19:50.817 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-01T15:19:50.854 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 39/198 2024-04-01T15:19:50.871 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-01T15:19:50.903 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 40/198 2024-04-01T15:19:50.927 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 53/198 2024-04-01T15:19:50.934 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 41/198 2024-04-01T15:19:50.974 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-01T15:19:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-01T15:19:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-01T15:19:51.229 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-01T15:19:51.388 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-01T15:19:51.400 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-01T15:19:51.466 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-01T15:19:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-01T15:19:51.723 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-01T15:19:51.784 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-01T15:19:51.983 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-01T15:19:52.043 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-01T15:19:52.121 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-01T15:19:52.170 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-01T15:19:52.213 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-01T15:19:52.259 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-01T15:19:52.262 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-01T15:19:52.298 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-01T15:19:52.366 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-01T15:19:52.371 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-01T15:19:52.407 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-01T15:19:52.431 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-01T15:19:52.458 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-01T15:19:52.470 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-01T15:19:52.519 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-01T15:19:52.536 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-01T15:19:52.592 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-01T15:19:52.650 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 53/198 2024-04-01T15:19:52.716 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-01T15:19:52.724 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-01T15:19:52.788 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-01T15:19:52.826 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-01T15:19:52.885 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-01T15:19:53.013 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-01T15:19:53.049 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-01T15:19:53.094 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-01T15:19:53.123 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-01T15:19:53.129 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-01T15:19:53.156 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-01T15:19:53.292 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-01T15:19:53.335 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-01T15:19:53.413 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-01T15:19:53.461 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-01T15:19:53.483 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-01T15:19:53.596 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-01T15:19:53.641 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-01T15:19:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-01T15:19:53.704 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-01T15:19:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-01T15:19:53.776 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-01T15:19:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-01T15:19:53.899 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-01T15:19:53.940 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-01T15:19:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-01T15:19:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-01T15:19:54.061 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-01T15:19:54.069 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-01T15:19:54.113 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-01T15:19:54.176 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-01T15:19:54.218 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-01T15:19:54.241 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-01T15:19:54.269 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-01T15:19:54.324 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-01T15:19:54.355 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-01T15:19:54.395 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-01T15:19:54.431 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-01T15:19:54.442 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-01T15:19:54.487 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-01T15:19:54.500 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-01T15:19:54.526 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-01T15:19:54.553 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-01T15:19:54.591 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-01T15:19:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-01T15:19:54.728 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-01T15:19:54.733 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-01T15:19:54.763 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-01T15:19:54.782 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-01T15:19:54.806 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-01T15:19:54.828 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-01T15:19:54.866 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-01T15:19:54.887 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-01T15:19:54.909 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-01T15:19:54.932 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-01T15:19:55.053 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-01T15:19:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-01T15:19:55.173 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-01T15:19:55.230 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-01T15:19:55.266 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-01T15:19:55.297 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-01T15:19:55.325 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-01T15:19:55.446 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-01T15:19:55.470 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-01T15:19:55.500 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-01T15:19:55.561 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-01T15:19:55.577 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-01T15:19:55.638 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-01T15:19:55.886 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-01T15:19:55.954 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-01T15:19:56.129 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-01T15:19:56.206 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-01T15:19:56.250 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-01T15:19:56.289 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-01T15:19:56.330 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-01T15:19:56.378 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-01T15:19:56.446 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-01T15:19:56.500 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-01T15:19:56.543 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-01T15:19:56.549 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-01T15:19:56.591 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-01T15:19:56.624 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-01T15:19:56.676 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-01T15:19:56.681 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-01T15:19:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-01T15:19:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-01T15:19:56.792 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-01T15:19:56.817 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-01T15:19:56.833 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-01T15:19:56.860 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-01T15:19:57.001 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-01T15:19:57.080 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-01T15:19:57.113 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-01T15:19:57.156 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-01T15:19:57.214 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-01T15:19:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-01T15:19:57.266 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-01T15:19:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-01T15:19:57.465 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-01T15:19:57.548 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-01T15:19:58.012 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-01T15:19:58.149 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-01T15:19:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-01T15:19:58.588 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-01T15:19:58.631 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-01T15:19:58.689 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-01T15:19:58.801 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-01T15:19:58.848 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-01T15:19:59.082 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-01T15:19:59.112 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-01T15:19:59.203 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-01T15:19:59.657 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-01T15:19:59.759 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-01T15:19:59.797 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-01T15:19:59.827 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-01T15:19:59.867 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-01T15:20:00.026 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-01T15:20:00.149 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-01T15:20:00.239 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-01T15:20:00.267 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 124/198 2024-04-01T15:20:00.388 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 124/198 2024-04-01T15:20:00.422 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 125/198 2024-04-01T15:20:00.476 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-01T15:20:01.020 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-01T15:20:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 128/198 2024-04-01T15:20:01.136 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 128/198 2024-04-01T15:20:01.163 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 129/198 2024-04-01T15:20:01.660 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-01T15:20:01.748 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-01T15:20:01.786 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-01T15:20:01.817 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-01T15:20:01.886 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-01T15:20:02.268 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-01T15:20:02.323 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 124/198 2024-04-01T15:20:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 124/198 2024-04-01T15:20:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 125/198 2024-04-01T15:20:02.556 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-01T15:20:03.109 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-01T15:20:03.142 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 128/198 2024-04-01T15:20:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 128/198 2024-04-01T15:20:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 129/198 2024-04-01T15:20:03.932 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-04-01T15:20:03.978 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-04-01T15:20:04.596 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-04-01T15:20:04.639 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 131/198 2024-04-01T15:20:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 131/198 2024-04-01T15:20:04.808 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-01T15:20:04.808 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-01T15:20:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 132/198 2024-04-01T15:20:05.948 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-04-01T15:20:05.993 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-04-01T15:20:06.631 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-04-01T15:20:06.679 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 131/198 2024-04-01T15:20:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 131/198 2024-04-01T15:20:06.845 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-01T15:20:06.845 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-01T15:20:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 132/198 2024-04-01T15:20:17.764 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 132/198 2024-04-01T15:20:17.764 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-04-01T15:20:17.764 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-04-01T15:20:17.764 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-04-01T15:20:17.764 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-04-01T15:20:17.765 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-04-01T15:20:17.765 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /root 2024-04-01T15:20:17.765 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-04-01T15:20:17.765 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 133/198 2024-04-01T15:20:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 133/198 2024-04-01T15:20:18.058 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:18.058 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-01T15:20:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:19.698 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 134/198 2024-04-01T15:20:19.775 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 134/198 2024-04-01T15:20:19.775 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:19.775 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-01T15:20:19.775 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T15:20:19.775 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T15:20:19.775 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 132/198 2024-04-01T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-04-01T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-04-01T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-04-01T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-04-01T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-04-01T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-04-01T15:20:19.793 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-04-01T15:20:19.793 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:19.992 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 133/198 2024-04-01T15:20:20.015 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 135/198 2024-04-01T15:20:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 133/198 2024-04-01T15:20:20.049 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:20.049 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-01T15:20:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:20.081 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 135/198 2024-04-01T15:20:20.081 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:20.081 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-01T15:20:20.081 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T15:20:20.081 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T15:20:20.081 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:20.574 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 136/198 2024-04-01T15:20:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 136/198 2024-04-01T15:20:20.640 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:20.640 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-01T15:20:20.640 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T15:20:20.640 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T15:20:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:20.768 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-01T15:20:21.383 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 138/198 2024-04-01T15:20:21.418 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 138/198 2024-04-01T15:20:21.477 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 139/198 2024-04-01T15:20:21.580 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 140/198 2024-04-01T15:20:21.584 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 134/198 2024-04-01T15:20:21.614 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 141/198 2024-04-01T15:20:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 134/198 2024-04-01T15:20:21.687 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:21.687 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-01T15:20:21.687 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T15:20:21.687 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T15:20:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:21.926 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 135/198 2024-04-01T15:20:22.008 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 135/198 2024-04-01T15:20:22.008 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:22.008 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-01T15:20:22.008 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T15:20:22.008 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T15:20:22.008 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:22.510 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 136/198 2024-04-01T15:20:22.576 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 136/198 2024-04-01T15:20:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-01T15:20:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T15:20:22.577 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T15:20:22.577 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:22.695 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-01T15:20:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 141/198 2024-04-01T15:20:22.891 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 142/198 2024-04-01T15:20:23.286 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 138/198 2024-04-01T15:20:23.329 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 138/198 2024-04-01T15:20:23.382 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 139/198 2024-04-01T15:20:23.494 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 140/198 2024-04-01T15:20:23.533 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 141/198 2024-04-01T15:20:23.972 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 142/198 2024-04-01T15:20:23.999 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 143/198 2024-04-01T15:20:24.142 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 143/198 2024-04-01T15:20:24.322 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 144/198 2024-04-01T15:20:24.351 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 145/198 2024-04-01T15:20:24.420 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 145/198 2024-04-01T15:20:24.420 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:24.420 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-01T15:20:24.420 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T15:20:24.420 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T15:20:24.420 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:24.477 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 146/198 2024-04-01T15:20:24.514 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 146/198 2024-04-01T15:20:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 147/198 2024-04-01T15:20:24.830 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 141/198 2024-04-01T15:20:24.877 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 142/198 2024-04-01T15:20:25.538 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-01T15:20:25.596 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 149/198 2024-04-01T15:20:25.666 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 149/198 2024-04-01T15:20:25.666 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:25.666 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-01T15:20:25.666 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T15:20:25.666 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T15:20:25.666 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:25.746 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 150/198 2024-04-01T15:20:25.819 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2574.gd2271 150/198 2024-04-01T15:20:25.819 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:25.819 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-01T15:20:25.819 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:25.891 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-04-01T15:20:25.961 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 142/198 2024-04-01T15:20:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-04-01T15:20:25.962 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:25.962 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-01T15:20:25.962 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T15:20:25.962 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T15:20:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:25.985 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 143/198 2024-04-01T15:20:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 143/198 2024-04-01T15:20:26.307 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 144/198 2024-04-01T15:20:26.333 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/198 2024-04-01T15:20:26.362 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 145/198 2024-04-01T15:20:26.403 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/198 2024-04-01T15:20:26.403 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:26.404 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-01T15:20:26.404 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T15:20:26.404 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T15:20:26.404 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:26.456 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 145/198 2024-04-01T15:20:26.456 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:26.456 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-01T15:20:26.456 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T15:20:26.456 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T15:20:26.456 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:26.513 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 146/198 2024-04-01T15:20:26.550 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 146/198 2024-04-01T15:20:26.649 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 147/198 2024-04-01T15:20:27.613 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-01T15:20:27.665 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 149/198 2024-04-01T15:20:27.759 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 149/198 2024-04-01T15:20:27.759 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:27.759 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-01T15:20:27.759 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T15:20:27.759 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T15:20:27.759 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:27.816 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 150/198 2024-04-01T15:20:27.912 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2574.gd2271 150/198 2024-04-01T15:20:27.912 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:27.912 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-01T15:20:27.912 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:28.000 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-04-01T15:20:28.105 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-04-01T15:20:28.105 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:28.105 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-01T15:20:28.105 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T15:20:28.105 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T15:20:28.105 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:28.527 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/198 2024-04-01T15:20:28.611 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/198 2024-04-01T15:20:28.611 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T15:20:28.611 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-01T15:20:28.611 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T15:20:28.611 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T15:20:28.612 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 153/198 2024-04-01T15:20:31.259 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 154/198 2024-04-01T15:20:31.295 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 155/198 2024-04-01T15:20:31.333 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-01T15:20:31.613 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 157/198 2024-04-01T15:20:31.747 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-01T15:20:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 159/198 2024-04-01T15:20:31.853 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-01T15:20:31.922 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-01T15:20:31.975 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-01T15:20:32.026 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 163/198 2024-04-01T15:20:32.072 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-01T15:20:32.123 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-04-01T15:20:32.213 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-04-01T15:20:32.322 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-01T15:20:32.363 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-01T15:20:33.193 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-01T15:20:33.236 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-01T15:20:33.290 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-01T15:20:33.406 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 153/198 2024-04-01T15:20:33.447 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 154/198 2024-04-01T15:20:33.479 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 155/198 2024-04-01T15:20:33.516 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-01T15:20:33.767 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 157/198 2024-04-01T15:20:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-01T15:20:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 159/198 2024-04-01T15:20:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-01T15:20:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-01T15:20:34.117 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-01T15:20:34.148 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 163/198 2024-04-01T15:20:34.205 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-01T15:20:34.256 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-04-01T15:20:34.347 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-04-01T15:20:34.454 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-01T15:20:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-01T15:20:34.575 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 170/198 2024-04-01T15:20:34.658 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-01T15:20:34.705 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-01T15:20:34.837 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-01T15:20:34.877 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-01T15:20:34.910 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-01T15:20:34.945 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-01T15:20:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-01T15:20:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-01T15:20:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-01T15:20:35.190 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-01T15:20:35.191 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-01T15:20:35.320 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-01T15:20:35.365 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-01T15:20:35.386 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-01T15:20:35.410 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-01T15:20:35.436 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-01T15:20:35.473 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-01T15:20:35.488 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-01T15:20:35.501 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-01T15:20:35.570 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-01T15:20:35.640 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-01T15:20:35.681 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-01T15:20:35.715 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-01T15:20:35.748 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-01T15:20:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-01T15:20:35.845 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-01T15:20:35.881 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-01T15:20:35.881 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-01T15:20:36.215 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-01T15:20:36.215 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-01T15:20:36.338 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-01T15:20:36.388 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-01T15:20:36.418 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-01T15:20:36.455 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-01T15:20:36.495 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-01T15:20:36.614 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-01T15:20:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 170/198 2024-04-01T15:20:36.867 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-01T15:20:36.867 INFO:teuthology.orchestra.run.smithi179.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-01T15:20:36.867 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:36.920 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-01T15:20:36.984 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-01T15:20:37.117 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-01T15:20:37.155 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-01T15:20:37.188 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-01T15:20:37.247 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-01T15:20:37.290 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-01T15:20:37.290 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-01T15:20:37.434 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-01T15:20:37.484 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-01T15:20:37.485 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-01T15:20:37.623 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-01T15:20:37.692 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-01T15:20:37.737 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-01T15:20:37.771 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-01T15:20:37.804 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-01T15:20:37.872 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-01T15:20:37.950 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-01T15:20:38.000 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-01T15:20:38.033 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-01T15:20:38.106 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-01T15:20:38.143 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-01T15:20:38.175 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-01T15:20:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-01T15:20:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-01T15:20:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-01T15:20:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-01T15:20:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-01T15:20:38.750 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-01T15:20:38.787 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-01T15:20:38.824 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-01T15:20:38.863 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-01T15:20:38.984 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-01T15:20:39.240 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-01T15:20:39.240 INFO:teuthology.orchestra.run.smithi142.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-01T15:20:39.240 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 1/198 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2/198 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 3/198 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 4/198 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 5/198 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 6/198 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 7/198 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 8/198 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 9/198 2024-04-01T15:20:42.202 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 12/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 13/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 14/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 15/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 17/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 18/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 19/198 2024-04-01T15:20:42.203 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 20/198 2024-04-01T15:20:42.204 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 21/198 2024-04-01T15:20:42.204 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 22/198 2024-04-01T15:20:42.204 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 23/198 2024-04-01T15:20:42.204 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 24/198 2024-04-01T15:20:42.204 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 25/198 2024-04-01T15:20:42.204 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 26/198 2024-04-01T15:20:42.204 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 27/198 2024-04-01T15:20:42.204 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 28/198 2024-04-01T15:20:42.204 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 29/198 2024-04-01T15:20:42.225 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 30/198 2024-04-01T15:20:42.225 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 31/198 2024-04-01T15:20:42.225 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 32/198 2024-04-01T15:20:42.225 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 33/198 2024-04-01T15:20:42.225 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 34/198 2024-04-01T15:20:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 35/198 2024-04-01T15:20:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 36/198 2024-04-01T15:20:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 37/198 2024-04-01T15:20:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 38/198 2024-04-01T15:20:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 39/198 2024-04-01T15:20:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-01T15:20:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-01T15:20:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-01T15:20:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-01T15:20:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-01T15:20:42.228 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-01T15:20:42.229 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-01T15:20:42.230 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-01T15:20:42.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-01T15:20:42.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-01T15:20:42.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-01T15:20:42.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 153/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-01T15:20:42.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-01T15:20:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-01T15:20:42.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-01T15:20:42.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-01T15:20:42.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-01T15:20:42.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-01T15:20:42.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-01T15:20:42.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-01T15:20:42.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-01T15:20:42.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-01T15:20:44.448 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 1/198 2024-04-01T15:20:44.448 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2/198 2024-04-01T15:20:44.448 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 3/198 2024-04-01T15:20:44.448 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 4/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 5/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 6/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 7/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 8/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 9/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 12/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 13/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 14/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 15/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-04-01T15:20:44.449 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 17/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 18/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 19/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 20/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 21/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 22/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 23/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 24/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 25/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 26/198 2024-04-01T15:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 27/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 28/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 29/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 30/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 31/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 32/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 33/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 34/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 35/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 36/198 2024-04-01T15:20:44.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 37/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 38/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 39/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-01T15:20:44.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-01T15:20:44.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-01T15:20:44.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-01T15:20:44.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-01T15:20:44.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-01T15:20:44.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-01T15:20:44.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-01T15:20:44.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-01T15:20:44.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-01T15:20:44.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-01T15:20:44.471 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-01T15:20:44.472 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-01T15:20:44.473 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-01T15:20:44.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-01T15:20:44.475 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 153/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-04-01T15:20:44.476 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-01T15:20:44.477 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-01T15:20:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-01T15:20:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-01T15:20:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-01T15:20:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-01T15:20:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-01T15:20:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-01T15:20:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-01T15:20:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-01T15:20:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-01T15:20:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-01T15:20:44.480 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-01T15:20:44.480 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-01T15:20:44.480 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-01T15:20:44.480 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: acl-2.3.1-4.el9.x86_64 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-01T15:20:44.717 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-01T15:20:44.718 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.2-8.el9.noarch 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.7.4-5.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.4-9.el9.x86_64 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-01T15:20:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.6-16.el9.x86_64 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.722 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-01T15:20:44.723 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: lua-5.4.4-4.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-13.14-1.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-01T15:20:44.724 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-01T15:20:44.725 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-01T15:20:44.726 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply-3.11-14.el9.noarch 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-01T15:20:44.727 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.728 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-01T15:20:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: re2-1:20211101-3.el9.x86_64 2024-04-01T15:20:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-01T15:20:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-01T15:20:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-01T15:20:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-01T15:20:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-01T15:20:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-01T15:20:44.731 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:44.731 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-04-01T15:20:45.402 DEBUG:teuthology.parallel:result is None 2024-04-01T15:20:47.036 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-01T15:20:47.036 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:47.036 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: acl-2.3.1-4.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-01T15:20:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-01T15:20:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-16.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-01T15:20:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-01T15:20:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.14-1.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-01T15:20:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-01T15:20:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-01T15:20:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-01T15:20:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-01T15:20:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-04-01T15:20:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-01T15:20:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-01T15:20:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-01T15:20:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-01T15:20:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-01T15:20:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-01T15:20:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:47.049 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-01T15:20:47.731 DEBUG:teuthology.parallel:result is None 2024-04-01T15:20:47.731 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T15:20:47.875 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T15:20:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-2574.gd2271579.el9 2024-04-01T15:20:47.930 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2574.gd2271579.el9 2024-04-01T15:20:47.930 INFO:teuthology.task.install:The correct ceph version 19.0.0-2574.gd2271579 is installed. 2024-04-01T15:20:47.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T15:20:48.146 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T15:20:48.203 INFO:teuthology.orchestra.run.smithi179.stdout:19.0.0-2574.gd2271579.el9 2024-04-01T15:20:48.203 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2574.gd2271579.el9 2024-04-01T15:20:48.203 INFO:teuthology.task.install:The correct ceph version 19.0.0-2574.gd2271579 is installed. 2024-04-01T15:20:48.205 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-01T15:20:48.205 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:48.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T15:20:48.290 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:20:48.290 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T15:20:48.371 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-01T15:20:48.372 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:48.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T15:20:48.446 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T15:20:48.557 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:20:48.557 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T15:20:48.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T15:20:48.742 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-01T15:20:48.742 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:48.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T15:20:48.817 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T15:20:48.930 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:20:48.930 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T15:20:49.006 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T15:20:49.135 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-01T15:20:49.135 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:49.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T15:20:49.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T15:20:49.319 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:20:49.319 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T15:20:49.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T15:20:49.503 INFO:teuthology.run_tasks:Running task ceph... 2024-04-01T15:20:49.578 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-01T15:20:49.578 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-04-01T15:20:49.583 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2024-04-01T15:20:49.656 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-01T15:20:49.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-01T15:20:49.661 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-01T15:20:49.730 INFO:tasks.ceph:Creating extra log directories... 2024-04-01T15:20:49.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-01T15:20:49.734 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-01T15:20:49.810 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-01T15:20:49.810 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-01T15:20:49.810 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-01T15:20:49.810 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:49.810 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-01T15:20:49.849 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-01T15:20:50.058 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-01T15:20:50.128 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:20:50.128 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-01T15:20:50.182 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-01T15:20:50.444 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-01T15:20:50.543 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-01T15:20:50.543 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-01T15:20:50.543 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914', 'branch': 'wip-vshankar-testing-20240330.170739', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7633914', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240330.170739'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240330.170739', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6891, 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'sleep_before_teardown': 0, 'subset': '932/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240330.170739', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDnUHOvfKGdJEm2fodfNtmvZNnB+RGSUECNtfnLkPDR6jx+5cNpV1Cm0OTNCsKrk0zc9NUNPbM/M7JZwvW0v6MU=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfqfJJuK2zrLLFX5mk7FrAsOBmKCSPKLBp5b8hvInZnN6q4HxWgjBPJ2hvmrPj2ZpOqll5lKCE3BtNr1Y/BsWI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'workunit': {'clients': {'client.0': ['client/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-04-01_14:09:42', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-01T15:20:50.544 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-01T15:20:50.551 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-01T15:20:50.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-04-01T15:20:50.635 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2024-04-01T15:20:50.727 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:50.727 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T15:20:50.769 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T15:20:50.769 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-04-01T15:20:50.849 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T15:20:50.849 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T15:20:50.849 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-04-01T15:20:50.849 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T15:20:50.849 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T15:20:50.849 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-01 15:20:39.660507912 +0000 2024-04-01T15:20:50.849 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-01 15:17:49.657518154 +0000 2024-04-01T15:20:50.849 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-01 15:17:49.657518154 +0000 2024-04-01T15:20:50.849 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-01 15:17:49.657518154 +0000 2024-04-01T15:20:50.850 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T15:20:50.957 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-01T15:20:50.957 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-01T15:20:50.957 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000329431 s, 1.6 MB/s 2024-04-01T15:20:50.960 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T15:20:51.003 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-04-01T15:20:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T15:20:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T15:20:51.093 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-04-01T15:20:51.093 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T15:20:51.093 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T15:20:51.093 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-01 15:20:39.661507893 +0000 2024-04-01T15:20:51.093 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-01 15:17:50.221507744 +0000 2024-04-01T15:20:51.094 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-01 15:17:50.221507744 +0000 2024-04-01T15:20:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-01 15:17:50.221507744 +0000 2024-04-01T15:20:51.094 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T15:20:51.175 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-01T15:20:51.175 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-01T15:20:51.175 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000334952 s, 1.5 MB/s 2024-04-01T15:20:51.178 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T15:20:51.230 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-04-01T15:20:51.277 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T15:20:51.278 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T15:20:51.278 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-04-01T15:20:51.278 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T15:20:51.278 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T15:20:51.278 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-01 15:20:39.662507875 +0000 2024-04-01T15:20:51.278 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-01 15:17:50.782497390 +0000 2024-04-01T15:20:51.278 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-01 15:17:50.782497390 +0000 2024-04-01T15:20:51.278 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-01 15:17:50.782497390 +0000 2024-04-01T15:20:51.278 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T15:20:51.357 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-01T15:20:51.357 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-01T15:20:51.357 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000308075 s, 1.7 MB/s 2024-04-01T15:20:51.361 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T15:20:51.414 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-04-01T15:20:51.462 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T15:20:51.462 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T15:20:51.462 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-04-01T15:20:51.462 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T15:20:51.462 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T15:20:51.462 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-01 15:20:39.663507856 +0000 2024-04-01T15:20:51.462 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-01 15:17:51.355486814 +0000 2024-04-01T15:20:51.462 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-01 15:17:51.355486814 +0000 2024-04-01T15:20:51.462 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-01 15:17:51.355486814 +0000 2024-04-01T15:20:51.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T15:20:51.543 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-01T15:20:51.543 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-01T15:20:51.543 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000353524 s, 1.4 MB/s 2024-04-01T15:20:51.547 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T15:20:51.600 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T15:20:51.600 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:20:51.600 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T15:20:51.657 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T15:20:51.657 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-04-01T15:20:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T15:20:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T15:20:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-04-01T15:20:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T15:20:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T15:20:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-01 15:20:37.284637239 +0000 2024-04-01T15:20:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-01 15:17:49.702575008 +0000 2024-04-01T15:20:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-01 15:17:49.702575008 +0000 2024-04-01T15:20:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-04-01 15:17:49.702575008 +0000 2024-04-01T15:20:51.710 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T15:20:51.799 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-01T15:20:51.799 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-01T15:20:51.799 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000324975 s, 1.6 MB/s 2024-04-01T15:20:51.803 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T15:20:51.860 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-04-01T15:20:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T15:20:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T15:20:51.910 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-04-01T15:20:51.910 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T15:20:51.910 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T15:20:51.910 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-01 15:20:37.285637217 +0000 2024-04-01T15:20:51.910 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-01 15:17:50.275562475 +0000 2024-04-01T15:20:51.910 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-01 15:17:50.275562475 +0000 2024-04-01T15:20:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-04-01 15:17:50.275562475 +0000 2024-04-01T15:20:51.911 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T15:20:51.997 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-01T15:20:51.997 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-01T15:20:51.997 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000375035 s, 1.4 MB/s 2024-04-01T15:20:52.001 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T15:20:52.055 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-04-01T15:20:52.104 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T15:20:52.104 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T15:20:52.104 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-04-01T15:20:52.104 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T15:20:52.104 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T15:20:52.104 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-01 15:20:37.285637217 +0000 2024-04-01T15:20:52.104 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-01 15:17:50.842550073 +0000 2024-04-01T15:20:52.104 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-01 15:17:50.842550073 +0000 2024-04-01T15:20:52.104 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-04-01 15:17:50.842550073 +0000 2024-04-01T15:20:52.104 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T15:20:52.190 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-01T15:20:52.190 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-01T15:20:52.190 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000349578 s, 1.5 MB/s 2024-04-01T15:20:52.193 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T15:20:52.248 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-04-01T15:20:52.297 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T15:20:52.298 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T15:20:52.298 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-04-01T15:20:52.298 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T15:20:52.298 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T15:20:52.298 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-01 15:20:37.286637195 +0000 2024-04-01T15:20:52.298 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-01 15:17:51.422537387 +0000 2024-04-01T15:20:52.298 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-01 15:17:51.422537387 +0000 2024-04-01T15:20:52.298 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-04-01 15:17:51.422537387 +0000 2024-04-01T15:20:52.298 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T15:20:52.384 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-01T15:20:52.384 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-01T15:20:52.384 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000322051 s, 1.6 MB/s 2024-04-01T15:20:52.388 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T15:20:52.442 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T15:20:52.442 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-01T15:20:52.442 INFO:tasks.ceph:Generating config... 2024-04-01T15:20:52.444 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-01T15:20:52.444 INFO:tasks.ceph:[client] debug client = 20 2024-04-01T15:20:52.444 INFO:tasks.ceph:[client] debug ms = 1 2024-04-01T15:20:52.444 INFO:tasks.ceph:[client] pid file = 2024-04-01T15:20:52.444 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-01T15:20:52.444 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-01T15:20:52.444 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-01T15:20:52.444 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-01T15:20:52.444 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-01T15:20:52.444 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-01T15:20:52.444 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-01T15:20:52.444 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-01T15:20:52.445 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-01T15:20:52.445 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-01T15:20:52.445 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-01T15:20:52.446 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-01T15:20:52.447 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-01T15:20:52.447 INFO:tasks.ceph:Setting up mon.a... 2024-04-01T15:20:52.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-01T15:20:52.581 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.keyring 2024-04-01T15:20:52.590 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-01T15:20:52.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T15:20:52.813 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.142'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2024-04-01T15:20:52.814 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.142,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-01T15:20:52.815 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:52.815 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-01T15:20:52.867 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.142 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:20:53.018 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:20:53.018 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: generated fsid 6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc 2024-04-01T15:20:53.018 INFO:teuthology.orchestra.run.smithi142.stdout:setting min_mon_release = quincy 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 0 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:fsid 6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:last_changed 2024-04-01T15:20:53.018049+0000 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-01T15:20:53.018049+0000 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:min_mon_release 17 (quincy) 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:election_strategy: 1 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-04-01T15:20:53.019 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-01T15:20:53.022 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-01T15:20:53.073 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc... 2024-04-01T15:20:53.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-01T15:20:53.078 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-04-01T15:20:53.241 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-04-01T15:20:53.242 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.142,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-04-01T15:20:53.243 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-04-01T15:20:53.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.245 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-04-01T15:20:53.246 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-04-01T15:20:53.247 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-01T15:20:53.248 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.249 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon down mkfs grace = 300 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:20:53.250 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-04-01T15:20:53.251 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-04-01T15:20:53.252 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-04-01T15:20:53.253 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-04-01T15:20:53.253 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-04-01T15:20:53.253 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-01T15:20:53.253 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-04-01T15:20:53.253 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.253 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-04-01T15:20:53.253 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.253 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-04-01T15:20:53.253 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-01T15:20:53.254 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-04-01T15:20:53.255 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.142,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc 2024-04-01T15:20:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-04-01T15:20:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.258 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-04-01T15:20:53.259 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-04-01T15:20:53.260 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-04-01T15:20:53.261 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.262 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: mon down mkfs grace = 300 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-04-01T15:20:53.263 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-04-01T15:20:53.264 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-04-01T15:20:53.265 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-04-01T15:20:53.288 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-01T15:20:53.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-01T15:20:53.426 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-01T15:20:53.426 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:53.426 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-01T15:20:53.477 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:53.477 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-01T15:20:53.518 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:20:53.518 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:53.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-01T15:20:53.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T15:20:53.691 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:20:53.691 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:20:53.787 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:20:53.787 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:20:53.788 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-01T15:20:53.788 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T15:20:53.937 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:20:53.937 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:20:54.033 INFO:tasks.ceph:Setting up mon nodes... 2024-04-01T15:20:54.033 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-01T15:20:54.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-01T15:20:54.212 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-01T15:20:54.223 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-01T15:20:54.410 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-01T15:20:54.421 INFO:tasks.ceph:Setting up mds nodes... 2024-04-01T15:20:54.422 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-01T15:20:54.603 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-01T15:20:54.612 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-01T15:20:54.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-01T15:20:54.877 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-01T15:20:54.886 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-01T15:20:54.970 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-01T15:20:54.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-01T15:20:55.101 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-01T15:20:55.157 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-01T15:20:55.157 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-01T15:20:55.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-01T15:20:55.242 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T15:20:55.242 INFO:tasks.ceph:role: osd.0 2024-04-01T15:20:55.242 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:20:55.242 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-01T15:20:55.335 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T15:20:55.336 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T15:20:55.336 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T15:20:55.336 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T15:20:55.336 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T15:20:55.336 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-01T15:20:55.336 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T15:20:55.336 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T15:20:55.336 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T15:20:55.336 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T15:20:55.837 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-01T15:20:55.844 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-01T15:20:55.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-01T15:20:56.011 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-01T15:20:56.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-01T15:20:56.205 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T15:20:56.205 INFO:tasks.ceph:role: osd.1 2024-04-01T15:20:56.205 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:20:56.205 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-01T15:20:56.296 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T15:20:56.296 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T15:20:56.296 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T15:20:56.297 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T15:20:56.297 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T15:20:56.297 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-01T15:20:56.297 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T15:20:56.297 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T15:20:56.297 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T15:20:56.297 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T15:20:56.771 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-01T15:20:56.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-01T15:20:56.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-01T15:20:56.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-01T15:20:56.990 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-01T15:20:57.073 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T15:20:57.074 INFO:tasks.ceph:role: osd.2 2024-04-01T15:20:57.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:20:57.074 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T15:20:57.156 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T15:20:57.660 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-01T15:20:57.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-01T15:20:57.666 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-01T15:20:57.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-01T15:20:57.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-01T15:20:58.029 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T15:20:58.029 INFO:tasks.ceph:role: osd.3 2024-04-01T15:20:58.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:20:58.029 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-01T15:20:58.125 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T15:20:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T15:20:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T15:20:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T15:20:58.126 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T15:20:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-01T15:20:58.126 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T15:20:58.126 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T15:20:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T15:20:58.126 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T15:20:58.576 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-01T15:20:58.582 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-01T15:20:58.582 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-01T15:20:58.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-01T15:20:58.785 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:20:58.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:20:58.950+0000 7f16dac8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-01T15:20:58.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:20:58.951+0000 7f16dac8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-01T15:20:58.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:20:58.951+0000 7f16dac8b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T15:20:58.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:20:58.951+0000 7f16dac8b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T15:20:58.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:20:58.951+0000 7f16dac8b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T15:20:58.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:20:58.955+0000 7f16dac8b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-01T15:21:01.892 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-01T15:21:01.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:21:02.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:02.123+0000 7f2d5f9ac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-01T15:21:02.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:02.124+0000 7f2d5f9ac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-01T15:21:02.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:02.124+0000 7f2d5f9ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T15:21:02.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:02.124+0000 7f2d5f9ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T15:21:02.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:02.124+0000 7f2d5f9ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T15:21:02.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:02.126+0000 7f2d5f9ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-01T15:21:05.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-01T15:21:05.140 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:21:05.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:05.259+0000 7f8c25e13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-01T15:21:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:05.259+0000 7f8c25e13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-01T15:21:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:05.259+0000 7f8c25e13640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T15:21:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:05.260+0000 7f8c25e13640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T15:21:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:05.260+0000 7f8c25e13640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T15:21:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:05.262+0000 7f8c25e13640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-01T15:21:08.190 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-01T15:21:08.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:21:08.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:08.416+0000 7fa0176f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-01T15:21:08.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:08.416+0000 7fa0176f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-01T15:21:08.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:08.417+0000 7fa0176f9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T15:21:08.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:08.417+0000 7fa0176f9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T15:21:08.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:08.417+0000 7fa0176f9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T15:21:08.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:08.419+0000 7fa0176f9640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-01T15:21:11.591 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-01T15:21:11.682 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-01T15:21:11.780 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T15:21:11.780 INFO:tasks.ceph:role: osd.4 2024-04-01T15:21:11.780 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:21:11.780 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-01T15:21:11.878 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T15:21:11.878 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T15:21:11.878 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T15:21:11.878 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T15:21:11.878 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T15:21:11.878 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-01T15:21:11.879 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T15:21:11.879 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T15:21:11.879 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T15:21:11.879 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T15:21:12.387 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-01T15:21:12.393 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-01T15:21:12.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-01T15:21:12.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-01T15:21:12.635 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-01T15:21:12.708 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T15:21:12.709 INFO:tasks.ceph:role: osd.5 2024-04-01T15:21:12.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:21:12.709 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-01T15:21:12.785 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T15:21:12.786 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T15:21:12.786 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T15:21:12.786 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T15:21:12.786 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T15:21:12.786 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-01T15:21:12.786 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T15:21:12.786 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T15:21:12.786 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T15:21:12.786 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T15:21:13.237 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-01T15:21:13.243 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-01T15:21:13.244 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-01T15:21:13.375 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-01T15:21:13.451 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-01T15:21:13.521 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T15:21:13.522 INFO:tasks.ceph:role: osd.6 2024-04-01T15:21:13.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:21:13.522 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-01T15:21:13.598 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T15:21:13.599 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T15:21:13.599 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T15:21:13.599 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T15:21:13.599 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T15:21:13.599 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-01T15:21:13.599 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T15:21:13.599 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T15:21:13.599 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T15:21:13.599 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T15:21:14.130 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-01T15:21:14.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-01T15:21:14.137 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-01T15:21:14.340 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-01T15:21:14.446 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-01T15:21:14.542 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T15:21:14.542 INFO:tasks.ceph:role: osd.7 2024-04-01T15:21:14.542 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:21:14.542 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-01T15:21:14.641 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T15:21:14.641 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T15:21:14.641 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T15:21:14.642 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T15:21:14.642 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T15:21:14.642 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-01T15:21:14.642 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T15:21:14.642 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T15:21:14.642 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T15:21:14.642 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T15:21:15.094 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-01T15:21:15.100 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-01T15:21:15.100 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-01T15:21:15.250 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-01T15:21:15.334 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:21:15.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:15.474+0000 7faee00a0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-01T15:21:15.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:15.477+0000 7faee00a0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-01T15:21:15.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:15.477+0000 7faee00a0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T15:21:15.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:15.477+0000 7faee00a0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T15:21:15.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:15.477+0000 7faee00a0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T15:21:15.488 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:15.486+0000 7faee00a0640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-01T15:21:18.662 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-01T15:21:18.757 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:21:18.898 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:18.896+0000 7f81be00e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-01T15:21:18.899 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:18.896+0000 7f81be00e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-01T15:21:18.899 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:18.897+0000 7f81be00e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T15:21:18.899 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:18.897+0000 7f81be00e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T15:21:18.899 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:18.897+0000 7f81be00e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T15:21:18.901 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:18.899+0000 7f81be00e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-01T15:21:20.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:21:20.553 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:21:21.827 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-01T15:21:21.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:21:22.056 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:22.055+0000 7f7686e1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-01T15:21:22.057 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:22.056+0000 7f7686e1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-01T15:21:22.057 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:22.056+0000 7f7686e1a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T15:21:22.057 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:22.056+0000 7f7686e1a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T15:21:22.057 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:22.056+0000 7f7686e1a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T15:21:22.059 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:22.058+0000 7f7686e1a640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-01T15:21:25.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-01T15:21:25.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:21:25.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:25.462+0000 7f349bd49640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-01T15:21:25.464 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:25.463+0000 7f349bd49640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-01T15:21:25.464 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:25.463+0000 7f349bd49640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T15:21:25.464 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:25.463+0000 7f349bd49640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T15:21:25.464 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:25.463+0000 7f349bd49640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T15:21:25.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:25.465+0000 7f349bd49640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-01T15:21:28.647 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-01T15:21:28.744 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-01T15:21:28.744 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:28.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-01T15:21:28.843 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:28.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-01T15:21:28.939 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:28.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-01T15:21:29.033 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:29.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-01T15:21:29.131 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:29.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-01T15:21:29.218 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:29.218 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-01T15:21:29.308 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:29.308 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-01T15:21:29.407 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:29.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-01T15:21:29.497 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:29.497 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-01T15:21:29.588 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:29.588 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-01T15:21:29.679 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:29.679 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-01T15:21:29.770 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:29.770 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-01T15:21:29.854 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:29.855 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-01T15:21:29.911 INFO:tasks.ceph:Adding keys to all mons... 2024-04-01T15:21:29.911 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-01T15:21:29.915 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-01T15:21:29.999 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-04-01T15:21:29.999 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDW0Apmf/+kDBAAPJ5/XhSX8yXXRzzH2VbNMg== 2024-04-01T15:21:29.999 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-04-01T15:21:29.999 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDW0ApmM1TuIxAA/uOamBNk9xYlRnXvmtOEKQ== 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDa0ApmAbW/OBAAjjHEaFw5MGFZCm4/pftRUw== 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDe0ApmVFZxBxAAyGJriuMbuiK7Wj/0Fz3+Rw== 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDh0Apmf/N1DxAA/SJe8FSb4sCiFUv95VQVmQ== 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDk0ApmpsfiGBAAqyH7Tjah7ZnNYn2y6xDZug== 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDW0ApmjtV1GBAAM8oDkqa4BTlYdH2Cnhlyag== 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDW0Apm7RdGNBAAtyIVT7of6zx0ViX+He1nPw== 2024-04-01T15:21:30.000 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-04-01T15:21:30.001 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDr0Apm/2tnHBAAQ+zh/7i9FBNO8dKUb2+i5w== 2024-04-01T15:21:30.001 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-04-01T15:21:30.001 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDu0ApmubWENRAAcVG86YF0KwT0yZKbm640mQ== 2024-04-01T15:21:30.001 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-04-01T15:21:30.001 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDy0ApmDslbAxAAYkJ+EMHFoX+6WvWnydCH4w== 2024-04-01T15:21:30.001 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-04-01T15:21:30.001 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD10ApmJA2ZGxAAHVyaaRF5qPfFpcDnT4yfFw== 2024-04-01T15:21:30.001 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-04-01T15:21:30.001 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDX0ApmIJgIBhAAZ6cXD22BBM3DcsPTv7AXJA== 2024-04-01T15:21:30.005 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2024-04-01T15:21:30.005 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDW0Apmf/+kDBAAPJ5/XhSX8yXXRzzH2VbNMg== 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDW0ApmM1TuIxAA/uOamBNk9xYlRnXvmtOEKQ== 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDa0ApmAbW/OBAAjjHEaFw5MGFZCm4/pftRUw== 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDe0ApmVFZxBxAAyGJriuMbuiK7Wj/0Fz3+Rw== 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDh0Apmf/N1DxAA/SJe8FSb4sCiFUv95VQVmQ== 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDk0ApmpsfiGBAAqyH7Tjah7ZnNYn2y6xDZug== 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2024-04-01T15:21:30.006 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDW0ApmjtV1GBAAM8oDkqa4BTlYdH2Cnhlyag== 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDW0Apm7RdGNBAAtyIVT7of6zx0ViX+He1nPw== 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDr0Apm/2tnHBAAQ+zh/7i9FBNO8dKUb2+i5w== 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDu0ApmubWENRAAcVG86YF0KwT0yZKbm640mQ== 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDy0ApmDslbAxAAYkJ+EMHFoX+6WvWnydCH4w== 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQD10ApmJA2ZGxAAHVyaaRF5qPfFpcDnT4yfFw== 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2024-04-01T15:21:30.007 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDX0ApmIJgIBhAAZ6cXD22BBM3DcsPTv7AXJA== 2024-04-01T15:21:30.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T15:21:30.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T15:21:30.195 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T15:21:30.202 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T15:21:30.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:30.348 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:30.483 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:30.487 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:30.628 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:30.634 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:30.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:30.784 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:30.930 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T15:21:30.937 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T15:21:31.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T15:21:31.078 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T15:21:31.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:31.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:31.371 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:31.376 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:31.510 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:31.515 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:31.655 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:31.661 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T15:21:31.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-01T15:21:31.808 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-01T15:21:31.956 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-01T15:21:31.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-01T15:21:32.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T15:21:32.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-01T15:21:32.280 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-01T15:21:32.374 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T15:21:32.528 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-01T15:21:32.620 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-01T15:21:32.710 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T15:21:32.866 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-01T15:21:32.958 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:21:32.965 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-01T15:21:33.018 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-01T15:21:33.018 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-01T15:21:33.018 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-01T15:21:33.023 INFO:tasks.ceph.mon.a:Started 2024-04-01T15:21:33.024 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-01T15:21:33.024 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-01T15:21:33.028 INFO:tasks.ceph.mon.b:Started 2024-04-01T15:21:33.029 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-01T15:21:33.029 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-01T15:21:33.033 INFO:tasks.ceph.mon.c:Started 2024-04-01T15:21:33.034 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-01T15:21:33.034 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-01T15:21:33.034 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-01T15:21:33.039 INFO:tasks.ceph.mgr.y:Started 2024-04-01T15:21:33.039 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-01T15:21:33.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-01T15:21:33.044 INFO:tasks.ceph.mgr.x:Started 2024-04-01T15:21:33.044 INFO:tasks.ceph:Setting crush tunables to default 2024-04-01T15:21:33.044 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd crush tunables default 2024-04-01T15:21:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.217+0000 7f581cc00640 1 Processor -- start 2024-04-01T15:21:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.217+0000 7f581cc00640 1 -- start start 2024-04-01T15:21:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f581cc00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 0x7f581806e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f581cc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f581814b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f581cc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581802c840 con 0x7f5818141de0 2024-04-01T15:21:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f581cc00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f58180b49f0 con 0x7f581802c460 2024-04-01T15:21:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f581cc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f58180b4cd0 con 0x7f58181419c0 2024-04-01T15:21:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5816800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5818141de0 0x7f581806cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51268/0 (socket says 172.21.15.142:51268) 2024-04-01T15:21:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5816800640 1 -- 172.21.15.142:0/781620042 learned_addr learned my addr 172.21.15.142:0/781620042 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f581814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815e00640 1 --2- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 0x7f581806e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815e00640 1 -- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 msgr2=0x7f581806e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815e00640 1 -- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 msgr2=0x7f581806e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815e00640 1 --2- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 0x7f581806e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815e00640 1 --2- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 0x7f581806e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815400640 1 -- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 msgr2=0x7f581814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815400640 1 -- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 msgr2=0x7f581814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f581814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T15:21:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.218+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f581814b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.419+0000 7f5815e00640 1 --2- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 0x7f581806e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.419+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f581814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.420+0000 7f5815e00640 1 -- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 msgr2=0x7f581806e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.420+0000 7f5815e00640 1 -- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 msgr2=0x7f581806e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.420+0000 7f5815e00640 1 --2- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 0x7f581806e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.420+0000 7f5815400640 1 -- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 msgr2=0x7f581814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.420+0000 7f5815400640 1 -- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 msgr2=0x7f581814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.420+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f581814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.420+0000 7f5815e00640 1 --2- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 0x7f581806e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T15:21:33.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.420+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f581814b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T15:21:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.471+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922037374 0 0) 0x7f581802c840 con 0x7f5818141de0 2024-04-01T15:21:33.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.471+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57f8003520 con 0x7f5818141de0 2024-04-01T15:21:33.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3131585708 0 0) 0x7f57f8003520 con 0x7f5818141de0 2024-04-01T15:21:33.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 msgr2=0x7f581814b120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f581814b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 msgr2=0x7f581806e100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 --2- 172.21.15.142:0/781620042 >> v2:172.21.15.179:3300/0 conn(0x7f581802c460 0x7f581806e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58180b4050 con 0x7f5818141de0 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f58100019f0 con 0x7f5818141de0 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 >> v1:172.21.15.142:6789/0 conn(0x7f5818141de0 legacy=0x7f581806cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f80039b0 0x7f57f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8004800 0x7f57f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f57f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58180b49f0 con 0x7f57f8004800 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f58180b4cd0 con 0x7f57f80039b0 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.472+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f57f800bac0 con 0x7f58181419c0 2024-04-01T15:21:33.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.473+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8004800 0x7f57f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.473+0000 7f5815e00640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f80039b0 0x7f57f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.473+0000 7f5816800640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f57f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.474+0000 7f5815400640 1 -- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 msgr2=0x7f57f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.474+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181419c0 0x7f57f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.474+0000 7f5815400640 1 -- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f80039b0 msgr2=0x7f57f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.474+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f80039b0 0x7f57f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.474+0000 7f5815400640 1 -- 172.21.15.142:0/781620042 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f8003520 con 0x7f57f8004800 2024-04-01T15:21:33.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.476+0000 7f5815400640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8004800 0x7f57f8004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5800006fd0 tx=0x7f57f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e222377ee3a810 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:33.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.478+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800032070 con 0x7f57f8004800 2024-04-01T15:21:33.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.478+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580002c7b0 con 0x7f57f8004800 2024-04-01T15:21:33.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.478+0000 7f5814a00640 1 -- 172.21.15.142:0/781620042 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580000d690 con 0x7f57f8004800 2024-04-01T15:21:33.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.479+0000 7f581cc00640 1 -- 172.21.15.142:0/781620042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8004800 msgr2=0x7f57f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:33.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.479+0000 7f581cc00640 1 --2- 172.21.15.142:0/781620042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8004800 0x7f57f8004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5800006fd0 tx=0x7f57f8005830 comp rx=0 tx=0).stop 2024-04-01T15:21:33.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.479+0000 7f5816800640 1 -- 172.21.15.142:0/781620042 reap_dead start 2024-04-01T15:21:33.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.479+0000 7f581cc00640 1 -- 172.21.15.142:0/781620042 shutdown_connections 2024-04-01T15:21:33.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.479+0000 7f581cc00640 1 -- 172.21.15.142:0/781620042 >> 172.21.15.142:0/781620042 conn(0x7f581809b300 msgr2=0x7f581809b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.479+0000 7f581cc00640 1 -- 172.21.15.142:0/781620042 shutdown_connections 2024-04-01T15:21:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.479+0000 7f581cc00640 1 -- 172.21.15.142:0/781620042 wait complete. 2024-04-01T15:21:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.482+0000 7f581cc00640 1 Processor -- start 2024-04-01T15:21:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.482+0000 7f581cc00640 1 -- start start 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.483+0000 7f581cc00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8004800 0x7f58180b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.483+0000 7f581cc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5818071630 0x7f58181e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.483+0000 7f581cc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181e0b30 0x7f581813cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.483+0000 7f581cc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f581806d5f0 con 0x7f5818071630 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.483+0000 7f581cc00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5818070350 con 0x7f57f8004800 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.483+0000 7f581cc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f581806d770 con 0x7f58181e0b30 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5815400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5818071630 0x7f58181e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5815400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5818071630 0x7f58181e05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40294/0 (socket says 172.21.15.142:40294) 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5815400640 1 -- 172.21.15.142:0/4013770427 learned_addr learned my addr 172.21.15.142:0/4013770427 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5815e00640 1 --2- 172.21.15.142:0/4013770427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8004800 0x7f58180b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5816800640 1 --2- 172.21.15.142:0/4013770427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181e0b30 0x7f581813cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5815400640 1 -- 172.21.15.142:0/4013770427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181e0b30 msgr2=0x7f581813cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5815400640 1 --2- 172.21.15.142:0/4013770427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181e0b30 0x7f581813cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5815400640 1 -- 172.21.15.142:0/4013770427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8004800 msgr2=0x7f58180b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5815400640 1 --2- 172.21.15.142:0/4013770427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8004800 0x7f58180b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.484+0000 7f5815400640 1 -- 172.21.15.142:0/4013770427 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5818072930 con 0x7f5818071630 2024-04-01T15:21:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.485+0000 7f5815400640 1 --2- 172.21.15.142:0/4013770427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5818071630 0x7f58181e05f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f580002c220 tx=0x7f58000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:33.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.485+0000 7f580e000640 1 -- 172.21.15.142:0/4013770427 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800044020 con 0x7f5818071630 2024-04-01T15:21:33.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.485+0000 7f580e000640 1 -- 172.21.15.142:0/4013770427 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5800036a40 con 0x7f5818071630 2024-04-01T15:21:33.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.485+0000 7f580e000640 1 -- 172.21.15.142:0/4013770427 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580000d690 con 0x7f5818071630 2024-04-01T15:21:33.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.485+0000 7f581cc00640 1 -- 172.21.15.142:0/4013770427 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5818142a50 con 0x7f5818071630 2024-04-01T15:21:33.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.485+0000 7f581cc00640 1 -- 172.21.15.142:0/4013770427 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5818072ed0 con 0x7f5818071630 2024-04-01T15:21:33.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.485+0000 7f580e000640 1 -- 172.21.15.142:0/4013770427 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5800047020 con 0x7f5818071630 2024-04-01T15:21:33.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.486+0000 7f580e000640 1 -- 172.21.15.142:0/4013770427 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5800049620 con 0x7f5818071630 2024-04-01T15:21:33.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.487+0000 7f581cc00640 1 -- 172.21.15.142:0/4013770427 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5818068710 con 0x7f5818071630 2024-04-01T15:21:33.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.490+0000 7f580e000640 1 -- 172.21.15.142:0/4013770427 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f580004e030 con 0x7f5818071630 2024-04-01T15:21:33.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.564+0000 7f581cc00640 1 -- 172.21.15.142:0/4013770427 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f58180b0730 con 0x7f5818071630 2024-04-01T15:21:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.567+0000 7f580e000640 1 -- 172.21.15.142:0/4013770427 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f580002ce20 con 0x7f5818071630 2024-04-01T15:21:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:adjusted tunables profile to default 2024-04-01T15:21:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.568+0000 7f581cc00640 1 -- 172.21.15.142:0/4013770427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5818071630 msgr2=0x7f58181e05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.568+0000 7f581cc00640 1 --2- 172.21.15.142:0/4013770427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5818071630 0x7f58181e05f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f580002c220 tx=0x7f58000046c0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.568+0000 7f581cc00640 1 -- 172.21.15.142:0/4013770427 shutdown_connections 2024-04-01T15:21:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.568+0000 7f581cc00640 1 --2- 172.21.15.142:0/4013770427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58181e0b30 0x7f581813cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.568+0000 7f581cc00640 1 --2- 172.21.15.142:0/4013770427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5818071630 0x7f58181e05f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.568+0000 7f581cc00640 1 --2- 172.21.15.142:0/4013770427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f8004800 0x7f58180b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.568+0000 7f581cc00640 1 -- 172.21.15.142:0/4013770427 >> 172.21.15.142:0/4013770427 conn(0x7f581809b300 msgr2=0x7f581806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.568+0000 7f581cc00640 1 -- 172.21.15.142:0/4013770427 shutdown_connections 2024-04-01T15:21:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:33.568+0000 7f581cc00640 1 -- 172.21.15.142:0/4013770427 wait complete. 2024-04-01T15:21:33.589 INFO:tasks.ceph:check_enable_crimson: False 2024-04-01T15:21:33.589 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-01T15:21:33.589 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:33.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-01T15:21:33.676 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:33.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-01T15:21:33.811 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:33.812 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-01T15:21:33.884 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:21:33.884 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-01T15:21:34.006 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:34.006 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-01T15:21:34.093 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:34.093 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-01T15:21:34.117 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:34.116+0000 7f436323c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T15:21:34.185 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:34.183+0000 7f436323c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T15:21:34.202 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:34.202 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-01T15:21:34.331 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-01T15:21:34.332 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-01T15:21:34.358 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:34.356+0000 7fa835612040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T15:21:34.415 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 4817062b-00fa-4b9f-814b-9cb2f2c43545 0 2024-04-01T15:21:34.417 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:34.416+0000 7fa835612040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T15:21:34.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.637+0000 7f3a4d000640 1 Processor -- start 2024-04-01T15:21:34.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.637+0000 7f3a4d000640 1 -- start start 2024-04-01T15:21:34.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.638+0000 7f3a4d000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a480b5fd0 0x7f3a4814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:34.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.638+0000 7f3a4d000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a480bde40 con 0x7f3a4814b610 2024-04-01T15:21:34.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.638+0000 7f3a4d000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a4814ba60 con 0x7f3a480bda60 2024-04-01T15:21:34.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.638+0000 7f3a4d000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3a480b5120 con 0x7f3a480b5fd0 2024-04-01T15:21:34.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.638+0000 7f3a45400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a480b5fd0 0x7f3a4814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:34.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.638+0000 7f3a45e00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3a480bda60 0x7f3a48141670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:49882/0 (socket says 172.21.15.179:49882) 2024-04-01T15:21:34.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.638+0000 7f3a45e00640 1 -- 172.21.15.179:0/1000499791 learned_addr learned my addr 172.21.15.179:0/1000499791 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-01T15:21:34.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.639+0000 7f3a45400640 1 -- 172.21.15.179:0/1000499791 >> v1:172.21.15.179:6789/0 conn(0x7f3a480bda60 legacy=0x7f3a48141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:34.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.639+0000 7f3a45400640 1 -- 172.21.15.179:0/1000499791 >> v1:172.21.15.142:6789/0 conn(0x7f3a4814b610 legacy=0x7f3a48152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:34.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.639+0000 7f3a45400640 1 -- 172.21.15.179:0/1000499791 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a480b53e0 con 0x7f3a480b5fd0 2024-04-01T15:21:34.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.640+0000 7f3a45400640 1 --2- 172.21.15.179:0/1000499791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a480b5fd0 0x7f3a4814b0d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a340097d0 tx=0x7f3a3402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=624df82b50896a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:34.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.640+0000 7f3a44a00640 1 -- 172.21.15.179:0/1000499791 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34035020 con 0x7f3a480b5fd0 2024-04-01T15:21:34.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.641+0000 7f3a44a00640 1 -- 172.21.15.179:0/1000499791 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a34031800 con 0x7f3a480b5fd0 2024-04-01T15:21:34.642 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.641+0000 7f3a44a00640 1 -- 172.21.15.179:0/1000499791 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34031bd0 con 0x7f3a480b5fd0 2024-04-01T15:21:34.642 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.641+0000 7f3a4d000640 1 -- 172.21.15.179:0/1000499791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a480b5fd0 msgr2=0x7f3a4814b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:34.642 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.641+0000 7f3a4d000640 1 --2- 172.21.15.179:0/1000499791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a480b5fd0 0x7f3a4814b0d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a340097d0 tx=0x7f3a3402b8a0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.641+0000 7f3a4d000640 1 -- 172.21.15.179:0/1000499791 shutdown_connections 2024-04-01T15:21:34.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.641+0000 7f3a4d000640 1 --2- 172.21.15.179:0/1000499791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a480b5fd0 0x7f3a4814b0d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.641+0000 7f3a4d000640 1 -- 172.21.15.179:0/1000499791 >> 172.21.15.179:0/1000499791 conn(0x7f3a480734b0 msgr2=0x7f3a480bd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:34.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.641+0000 7f3a4d000640 1 -- 172.21.15.179:0/1000499791 shutdown_connections 2024-04-01T15:21:34.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.641+0000 7f3a4d000640 1 -- 172.21.15.179:0/1000499791 wait complete. 2024-04-01T15:21:34.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.643+0000 7f3a4d000640 1 Processor -- start 2024-04-01T15:21:34.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.643+0000 7f3a4d000640 1 -- start start 2024-04-01T15:21:34.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.643+0000 7f3a4d000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a480b5fd0 0x7f3a48146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:34.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.643+0000 7f3a4d000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a480bda60 0x7f3a481e1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:34.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.643+0000 7f3a4d000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a4814b610 0x7f3a481e1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:34.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a4d000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a480b49c0 con 0x7f3a480bda60 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a4d000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a480b70a0 con 0x7f3a480b5fd0 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a4d000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3a480b4b40 con 0x7f3a4814b610 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a46800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a4814b610 0x7f3a481e1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a45e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a480b5fd0 0x7f3a48146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a46800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a4814b610 0x7f3a481e1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45224/0 (socket says 172.21.15.179:45224) 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a45e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a480b5fd0 0x7f3a48146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:35466/0 (socket says 172.21.15.179:35466) 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a46800640 1 -- 172.21.15.179:0/2531911322 learned_addr learned my addr 172.21.15.179:0/2531911322 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a45400640 1 --2- 172.21.15.179:0/2531911322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a480bda60 0x7f3a481e1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a46800640 1 -- 172.21.15.179:0/2531911322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a480b5fd0 msgr2=0x7f3a48146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a46800640 1 --2- 172.21.15.179:0/2531911322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a480b5fd0 0x7f3a48146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a46800640 1 -- 172.21.15.179:0/2531911322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a480bda60 msgr2=0x7f3a481e1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a46800640 1 --2- 172.21.15.179:0/2531911322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a480bda60 0x7f3a481e1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a46800640 1 -- 172.21.15.179:0/2531911322 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a48145a30 con 0x7f3a4814b610 2024-04-01T15:21:34.646 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.644+0000 7f3a45400640 1 --2- 172.21.15.179:0/2531911322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a480bda60 0x7f3a481e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:21:34.647 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.645+0000 7f3a46800640 1 --2- 172.21.15.179:0/2531911322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a4814b610 0x7f3a481e1890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c6b0 tx=0x7f3a4000cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:34.647 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.645+0000 7f3a3e000640 1 -- 172.21.15.179:0/2531911322 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40003b70 con 0x7f3a4814b610 2024-04-01T15:21:34.648 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.645+0000 7f3a3e000640 1 -- 172.21.15.179:0/2531911322 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a40003d30 con 0x7f3a4814b610 2024-04-01T15:21:34.648 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.645+0000 7f3a3e000640 1 -- 172.21.15.179:0/2531911322 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40005310 con 0x7f3a4814b610 2024-04-01T15:21:34.648 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.645+0000 7f3a4d000640 1 -- 172.21.15.179:0/2531911322 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a481483d0 con 0x7f3a4814b610 2024-04-01T15:21:34.648 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.645+0000 7f3a4d000640 1 -- 172.21.15.179:0/2531911322 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a48146770 con 0x7f3a4814b610 2024-04-01T15:21:34.648 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.645+0000 7f3a3e000640 1 -- 172.21.15.179:0/2531911322 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a400054b0 con 0x7f3a4814b610 2024-04-01T15:21:34.648 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.645+0000 7f3a3e000640 1 -- 172.21.15.179:0/2531911322 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f3a400128a0 con 0x7f3a4814b610 2024-04-01T15:21:34.648 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.646+0000 7f3a4d000640 1 -- 172.21.15.179:0/2531911322 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a48145820 con 0x7f3a4814b610 2024-04-01T15:21:34.650 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.649+0000 7f3a3e000640 1 -- 172.21.15.179:0/2531911322 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3a40012aa0 con 0x7f3a4814b610 2024-04-01T15:21:34.729 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.728+0000 7f3a4d000640 1 -- 172.21.15.179:0/2531911322 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4817062b-00fa-4b9f-814b-9cb2f2c43545", "id": 0} v 0) -- 0x7f3a48068710 con 0x7f3a4814b610 2024-04-01T15:21:34.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.735+0000 7f3a3e000640 1 -- 172.21.15.179:0/2531911322 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4817062b-00fa-4b9f-814b-9cb2f2c43545", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f3a40012c80 con 0x7f3a4814b610 2024-04-01T15:21:34.736 INFO:teuthology.orchestra.run.smithi179.stdout:0 2024-04-01T15:21:34.738 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.737+0000 7f3a4d000640 1 -- 172.21.15.179:0/2531911322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a4814b610 msgr2=0x7f3a481e1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:34.738 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.737+0000 7f3a4d000640 1 --2- 172.21.15.179:0/2531911322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a4814b610 0x7f3a481e1890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c6b0 tx=0x7f3a4000cb70 comp rx=0 tx=0).stop 2024-04-01T15:21:34.738 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.737+0000 7f3a4d000640 1 -- 172.21.15.179:0/2531911322 shutdown_connections 2024-04-01T15:21:34.738 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.737+0000 7f3a4d000640 1 --2- 172.21.15.179:0/2531911322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a4814b610 0x7f3a481e1890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.738 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.737+0000 7f3a4d000640 1 --2- 172.21.15.179:0/2531911322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a480bda60 0x7f3a481e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.738 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.737+0000 7f3a4d000640 1 --2- 172.21.15.179:0/2531911322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a480b5fd0 0x7f3a48146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.738 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.737+0000 7f3a4d000640 1 -- 172.21.15.179:0/2531911322 >> 172.21.15.179:0/2531911322 conn(0x7f3a480734b0 msgr2=0x7f3a4813f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:34.738 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.737+0000 7f3a4d000640 1 -- 172.21.15.179:0/2531911322 shutdown_connections 2024-04-01T15:21:34.739 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.737+0000 7f3a4d000640 1 -- 172.21.15.179:0/2531911322 wait complete. 2024-04-01T15:21:34.755 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new d77f5b2b-2284-4192-a3e8-f3c45d65472d 1 2024-04-01T15:21:34.831 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:34.830+0000 7f436323c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T15:21:34.897 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:34.895+0000 7f436323c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T15:21:34.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.942+0000 7fbf3ce00640 1 Processor -- start 2024-04-01T15:21:34.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.942+0000 7fbf3ce00640 1 -- start start 2024-04-01T15:21:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.943+0000 7fbf3ce00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380bd7f0 0x7fbf38141150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.943+0000 7fbf3ce00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbf380b5ca0 0x7fbf38141690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.943+0000 7fbf3ce00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf380bdbd0 con 0x7fbf3814ac50 2024-04-01T15:21:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.943+0000 7fbf3ce00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbf380b49c0 con 0x7fbf380b5ca0 2024-04-01T15:21:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.943+0000 7fbf3ce00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbf380b4ca0 con 0x7fbf380bd7f0 2024-04-01T15:21:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.944+0000 7fbf37400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380bd7f0 0x7fbf38141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.944+0000 7fbf37400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380bd7f0 0x7fbf38141150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45228/0 (socket says 172.21.15.179:45228) 2024-04-01T15:21:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.944+0000 7fbf37400640 1 -- 172.21.15.179:0/3865781401 learned_addr learned my addr 172.21.15.179:0/3865781401 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.944+0000 7fbf36a00640 1 --2- 172.21.15.179:0/3865781401 >> v2:172.21.15.142:3300/0 conn(0x7fbf380b5ca0 0x7fbf38141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.944+0000 7fbf37400640 1 -- 172.21.15.179:0/3865781401 >> v2:172.21.15.142:3300/0 conn(0x7fbf380b5ca0 msgr2=0x7fbf38141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.944+0000 7fbf37400640 1 --2- 172.21.15.179:0/3865781401 >> v2:172.21.15.142:3300/0 conn(0x7fbf380b5ca0 0x7fbf38141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.944+0000 7fbf37400640 1 -- 172.21.15.179:0/3865781401 >> v1:172.21.15.142:6789/0 conn(0x7fbf3814ac50 legacy=0x7fbf3814b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.944+0000 7fbf37400640 1 -- 172.21.15.179:0/3865781401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf380b6fc0 con 0x7fbf380bd7f0 2024-04-01T15:21:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.945+0000 7fbf37400640 1 --2- 172.21.15.179:0/3865781401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380bd7f0 0x7fbf38141150 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf2802b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d5ddb75e4712ea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.945+0000 7fbf36000640 1 -- 172.21.15.179:0/3865781401 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28038070 con 0x7fbf380bd7f0 2024-04-01T15:21:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.945+0000 7fbf36000640 1 -- 172.21.15.179:0/3865781401 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf28031740 con 0x7fbf380bd7f0 2024-04-01T15:21:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.945+0000 7fbf36000640 1 -- 172.21.15.179:0/3865781401 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2802f050 con 0x7fbf380bd7f0 2024-04-01T15:21:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.946+0000 7fbf3ce00640 1 -- 172.21.15.179:0/3865781401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380bd7f0 msgr2=0x7fbf38141150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.946+0000 7fbf3ce00640 1 --2- 172.21.15.179:0/3865781401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380bd7f0 0x7fbf38141150 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf2802b7e0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.946+0000 7fbf3ce00640 1 -- 172.21.15.179:0/3865781401 shutdown_connections 2024-04-01T15:21:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.946+0000 7fbf3ce00640 1 --2- 172.21.15.179:0/3865781401 >> v2:172.21.15.142:3300/0 conn(0x7fbf380b5ca0 0x7fbf38141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.946+0000 7fbf3ce00640 1 --2- 172.21.15.179:0/3865781401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380bd7f0 0x7fbf38141150 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.946+0000 7fbf3ce00640 1 -- 172.21.15.179:0/3865781401 >> 172.21.15.179:0/3865781401 conn(0x7fbf38073280 msgr2=0x7fbf380bce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.946+0000 7fbf3ce00640 1 -- 172.21.15.179:0/3865781401 shutdown_connections 2024-04-01T15:21:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.946+0000 7fbf3ce00640 1 -- 172.21.15.179:0/3865781401 wait complete. 2024-04-01T15:21:34.949 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:34.948+0000 7f436323c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T15:21:34.950 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.949+0000 7fbf3ce00640 1 Processor -- start 2024-04-01T15:21:34.950 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.949+0000 7fbf3ce00640 1 -- start start 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf3ce00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380b5ca0 0x7fbf3814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf3ce00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf380bd7f0 0x7fbf3814cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf3ce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf3814ac50 0x7fbf38142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf3ce00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbf380b95e0 con 0x7fbf3814ac50 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf3ce00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbf38151f50 con 0x7fbf380bd7f0 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf3ce00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3814bdc0 con 0x7fbf380b5ca0 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf37400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380b5ca0 0x7fbf3814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf37400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380b5ca0 0x7fbf3814c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45230/0 (socket says 172.21.15.179:45230) 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf37400640 1 -- 172.21.15.179:0/2133158585 learned_addr learned my addr 172.21.15.179:0/2133158585 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.950+0000 7fbf36a00640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf380bd7f0 0x7fbf3814cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf37e00640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf3814ac50 0x7fbf38142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf37400640 1 -- 172.21.15.179:0/2133158585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf380bd7f0 msgr2=0x7fbf3814cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf37400640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf380bd7f0 0x7fbf3814cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf37400640 1 -- 172.21.15.179:0/2133158585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf3814ac50 msgr2=0x7fbf38142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf37400640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf3814ac50 0x7fbf38142f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf37400640 1 -- 172.21.15.179:0/2133158585 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3814db80 con 0x7fbf380b5ca0 2024-04-01T15:21:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf36a00640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf380bd7f0 0x7fbf3814cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:21:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf37400640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380b5ca0 0x7fbf3814c710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:34.954 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf2f400640 1 -- 172.21.15.179:0/2133158585 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28043070 con 0x7fbf380b5ca0 2024-04-01T15:21:34.954 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf2f400640 1 -- 172.21.15.179:0/2133158585 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf280338e0 con 0x7fbf380b5ca0 2024-04-01T15:21:34.954 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.951+0000 7fbf2f400640 1 -- 172.21.15.179:0/2133158585 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28038040 con 0x7fbf380b5ca0 2024-04-01T15:21:34.954 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.952+0000 7fbf3ce00640 1 -- 172.21.15.179:0/2133158585 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3814e0d0 con 0x7fbf380b5ca0 2024-04-01T15:21:34.954 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.952+0000 7fbf3ce00640 1 -- 172.21.15.179:0/2133158585 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3814ba50 con 0x7fbf380b5ca0 2024-04-01T15:21:34.955 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.952+0000 7fbf2f400640 1 -- 172.21.15.179:0/2133158585 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbf28046070 con 0x7fbf380b5ca0 2024-04-01T15:21:34.955 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.952+0000 7fbf2f400640 1 -- 172.21.15.179:0/2133158585 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fbf28048450 con 0x7fbf380b5ca0 2024-04-01T15:21:34.955 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.953+0000 7fbf3ce00640 1 -- 172.21.15.179:0/2133158585 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf38068590 con 0x7fbf380b5ca0 2024-04-01T15:21:34.956 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:34.955+0000 7fbf2f400640 1 -- 172.21.15.179:0/2133158585 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbf2804d030 con 0x7fbf380b5ca0 2024-04-01T15:21:35.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:35.013+0000 7f436323c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T15:21:35.028 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.027+0000 7fa835612040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T15:21:35.036 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.035+0000 7fbf3ce00640 1 -- 172.21.15.179:0/2133158585 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d77f5b2b-2284-4192-a3e8-f3c45d65472d", "id": 1} v 0) -- 0x7fbf3814ddf0 con 0x7fbf380b5ca0 2024-04-01T15:21:35.043 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.042+0000 7fbf2f400640 1 -- 172.21.15.179:0/2133158585 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d77f5b2b-2284-4192-a3e8-f3c45d65472d", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fbf28033cd0 con 0x7fbf380b5ca0 2024-04-01T15:21:35.044 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-04-01T15:21:35.045 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.044+0000 7fbf3ce00640 1 -- 172.21.15.179:0/2133158585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380b5ca0 msgr2=0x7fbf3814c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.045 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.044+0000 7fbf3ce00640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380b5ca0 0x7fbf3814c710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf280046c0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.045 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.044+0000 7fbf3ce00640 1 -- 172.21.15.179:0/2133158585 shutdown_connections 2024-04-01T15:21:35.045 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.044+0000 7fbf3ce00640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf3814ac50 0x7fbf38142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.045 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.044+0000 7fbf3ce00640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf380bd7f0 0x7fbf3814cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.045 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.044+0000 7fbf3ce00640 1 --2- 172.21.15.179:0/2133158585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf380b5ca0 0x7fbf3814c710 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.045 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.044+0000 7fbf3ce00640 1 -- 172.21.15.179:0/2133158585 >> 172.21.15.179:0/2133158585 conn(0x7fbf38073280 msgr2=0x7fbf3813f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:35.045 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.044+0000 7fbf3ce00640 1 -- 172.21.15.179:0/2133158585 shutdown_connections 2024-04-01T15:21:35.045 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.044+0000 7fbf3ce00640 1 -- 172.21.15.179:0/2133158585 wait complete. 2024-04-01T15:21:35.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 913404ba-9757-4c51-9011-d79f9a575b24 2 2024-04-01T15:21:35.067 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:35.065+0000 7f436323c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T15:21:35.091 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.090+0000 7fa835612040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T15:21:35.141 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.139+0000 7fa835612040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T15:21:35.201 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.200+0000 7fa835612040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T15:21:35.204 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:35.203+0000 7f436323c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T15:21:35.245 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.243+0000 7f4656400640 1 Processor -- start 2024-04-01T15:21:35.245 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.244+0000 7f4656400640 1 -- start start 2024-04-01T15:21:35.246 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f4656400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f4650147be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.246 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f4656400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4650147730 0x7f465014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.246 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f4656400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46500b4e80 con 0x7f46500af7a0 2024-04-01T15:21:35.246 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f4656400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f46500af030 con 0x7f4650147730 2024-04-01T15:21:35.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f4656400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4650148120 con 0x7f46500b4aa0 2024-04-01T15:21:35.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f464f400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f4650147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f464f400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f4650147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45232/0 (socket says 172.21.15.179:45232) 2024-04-01T15:21:35.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f464f400640 1 -- 172.21.15.179:0/3331642956 learned_addr learned my addr 172.21.15.179:0/3331642956 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:35.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f464fe00640 1 --2- 172.21.15.179:0/3331642956 >> v2:172.21.15.142:3300/0 conn(0x7f4650147730 0x7f465014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f464f400640 1 -- 172.21.15.179:0/3331642956 >> v2:172.21.15.142:3300/0 conn(0x7f4650147730 msgr2=0x7f465014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:35.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f464f400640 1 --2- 172.21.15.179:0/3331642956 >> v2:172.21.15.142:3300/0 conn(0x7f4650147730 0x7f465014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f464f400640 1 -- 172.21.15.179:0/3331642956 >> v1:172.21.15.142:6789/0 conn(0x7f46500af7a0 legacy=0x7f4650147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:35.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.245+0000 7f464f400640 1 -- 172.21.15.179:0/3331642956 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46500b0bf0 con 0x7f46500b4aa0 2024-04-01T15:21:35.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.246+0000 7f464f400640 1 --2- 172.21.15.179:0/3331642956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f4650147be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4640009870 tx=0x7f464002b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e23f34b3be40d098 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:35.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f464ea00640 1 -- 172.21.15.179:0/3331642956 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640038070 con 0x7f46500b4aa0 2024-04-01T15:21:35.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f464ea00640 1 -- 172.21.15.179:0/3331642956 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4640031740 con 0x7f46500b4aa0 2024-04-01T15:21:35.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f464ea00640 1 -- 172.21.15.179:0/3331642956 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464002f050 con 0x7f46500b4aa0 2024-04-01T15:21:35.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f4656400640 1 -- 172.21.15.179:0/3331642956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 msgr2=0x7f4650147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f4656400640 1 --2- 172.21.15.179:0/3331642956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f4650147be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4640009870 tx=0x7f464002b7e0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f4656400640 1 -- 172.21.15.179:0/3331642956 shutdown_connections 2024-04-01T15:21:35.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f4656400640 1 --2- 172.21.15.179:0/3331642956 >> v2:172.21.15.142:3300/0 conn(0x7f4650147730 0x7f465014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f4656400640 1 --2- 172.21.15.179:0/3331642956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f4650147be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f4656400640 1 -- 172.21.15.179:0/3331642956 >> 172.21.15.179:0/3331642956 conn(0x7f46500b8f00 msgr2=0x7f46500b92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:35.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f4656400640 1 -- 172.21.15.179:0/3331642956 shutdown_connections 2024-04-01T15:21:35.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.247+0000 7f4656400640 1 -- 172.21.15.179:0/3331642956 wait complete. 2024-04-01T15:21:35.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.249+0000 7f4656400640 1 Processor -- start 2024-04-01T15:21:35.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.249+0000 7f4656400640 1 -- start start 2024-04-01T15:21:35.250 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.248+0000 7fa835612040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T15:21:35.251 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f4656400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46500af7a0 0x7f4650143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.251 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f4656400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f46501ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.251 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f4656400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4650147730 0x7f46500b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f4656400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f46500b3130 con 0x7f4650147730 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f4656400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f46500af280 con 0x7f46500af7a0 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f4656400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f465006db90 con 0x7f46500b4aa0 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464f400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46500af7a0 0x7f4650143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f4647e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f46501ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464f400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46500af7a0 0x7f4650143560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:35484/0 (socket says 172.21.15.179:35484) 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464f400640 1 -- 172.21.15.179:0/3642094183 learned_addr learned my addr 172.21.15.179:0/3642094183 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464fe00640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4650147730 0x7f46500b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464f400640 1 -- 172.21.15.179:0/3642094183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 msgr2=0x7f46501ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464f400640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f46501ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464f400640 1 -- 172.21.15.179:0/3642094183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4650147730 msgr2=0x7f46500b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464f400640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4650147730 0x7f46500b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464f400640 1 -- 172.21.15.179:0/3642094183 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46501cf170 con 0x7f46500af7a0 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f4647e00640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f46501ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:21:35.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.250+0000 7f464fe00640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4650147730 0x7f46500b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:21:35.253 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.251+0000 7f464f400640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46500af7a0 0x7f4650143560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4640000c00 tx=0x7f46400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:35.253 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.251+0000 7f4647400640 1 -- 172.21.15.179:0/3642094183 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640043070 con 0x7f46500af7a0 2024-04-01T15:21:35.253 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.251+0000 7f4647400640 1 -- 172.21.15.179:0/3642094183 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400338e0 con 0x7f46500af7a0 2024-04-01T15:21:35.254 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.251+0000 7f4656400640 1 -- 172.21.15.179:0/3642094183 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46501cff20 con 0x7f46500af7a0 2024-04-01T15:21:35.254 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.251+0000 7f4647400640 1 -- 172.21.15.179:0/3642094183 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640038040 con 0x7f46500af7a0 2024-04-01T15:21:35.254 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.251+0000 7f4656400640 1 -- 172.21.15.179:0/3642094183 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46501cee00 con 0x7f46500af7a0 2024-04-01T15:21:35.254 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.252+0000 7f4647400640 1 -- 172.21.15.179:0/3642094183 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4640046070 con 0x7f46500af7a0 2024-04-01T15:21:35.254 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.252+0000 7f4647400640 1 -- 172.21.15.179:0/3642094183 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f4640048450 con 0x7f46500af7a0 2024-04-01T15:21:35.254 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.252+0000 7f4656400640 1 -- 172.21.15.179:0/3642094183 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4650145120 con 0x7f46500af7a0 2024-04-01T15:21:35.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.255+0000 7f4647400640 1 -- 172.21.15.179:0/3642094183 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4650145120 con 0x7f46500af7a0 2024-04-01T15:21:35.288 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:35.287+0000 7f436323c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T15:21:35.335 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.334+0000 7f4656400640 1 -- 172.21.15.179:0/3642094183 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "913404ba-9757-4c51-9011-d79f9a575b24", "id": 2} v 0) -- 0x7f46501cebf0 con 0x7f46500af7a0 2024-04-01T15:21:35.342 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.341+0000 7f4647400640 1 -- 172.21.15.179:0/3642094183 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "913404ba-9757-4c51-9011-d79f9a575b24", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f464004d030 con 0x7f46500af7a0 2024-04-01T15:21:35.342 INFO:teuthology.orchestra.run.smithi179.stdout:2 2024-04-01T15:21:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.342+0000 7f4656400640 1 -- 172.21.15.179:0/3642094183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46500af7a0 msgr2=0x7f4650143560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.342+0000 7f4656400640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46500af7a0 0x7f4650143560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4640000c00 tx=0x7f46400046c0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.343+0000 7f4656400640 1 -- 172.21.15.179:0/3642094183 shutdown_connections 2024-04-01T15:21:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.343+0000 7f4656400640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4650147730 0x7f46500b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.343+0000 7f4656400640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46500b4aa0 0x7f46501ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.343+0000 7f4656400640 1 --2- 172.21.15.179:0/3642094183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46500af7a0 0x7f4650143560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.343+0000 7f4656400640 1 -- 172.21.15.179:0/3642094183 >> 172.21.15.179:0/3642094183 conn(0x7f46500b8f00 msgr2=0x7f46500b92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.343+0000 7f4656400640 1 -- 172.21.15.179:0/3642094183 shutdown_connections 2024-04-01T15:21:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.343+0000 7f4656400640 1 -- 172.21.15.179:0/3642094183 wait complete. 2024-04-01T15:21:35.345 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:35.344+0000 7f436323c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T15:21:35.361 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new dc946de0-8ebd-4054-a17b-7386b3255d4f 3 2024-04-01T15:21:35.380 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.379+0000 7fa835612040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T15:21:35.408 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:35.407+0000 7f436323c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T15:21:35.459 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.457+0000 7fa835612040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T15:21:35.466 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:35.465+0000 7f436323c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T15:21:35.512 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.510+0000 7fa835612040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T15:21:35.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.555+0000 7f436ca00640 1 Processor -- start 2024-04-01T15:21:35.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.555+0000 7f436ca00640 1 -- start start 2024-04-01T15:21:35.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.556+0000 7f436ca00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f436806d130 0x7f4368148c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.556+0000 7f436ca00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f43681491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.556+0000 7f436ca00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43680b7620 con 0x7f436813f600 2024-04-01T15:21:35.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.556+0000 7f436ca00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f436813f9e0 con 0x7f436806d130 2024-04-01T15:21:35.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.556+0000 7f436ca00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f43680b7900 con 0x7f436806d5a0 2024-04-01T15:21:35.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.556+0000 7f4367e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f43681491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.556+0000 7f4366a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f436806d130 0x7f4368148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.557+0000 7f4367e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f43681491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45240/0 (socket says 172.21.15.179:45240) 2024-04-01T15:21:35.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.557+0000 7f4367e00640 1 -- 172.21.15.179:0/3698715061 learned_addr learned my addr 172.21.15.179:0/3698715061 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:35.559 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.557+0000 7f4367e00640 1 -- 172.21.15.179:0/3698715061 >> v2:172.21.15.179:3300/0 conn(0x7f436806d130 msgr2=0x7f4368148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:35.559 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.557+0000 7f4367e00640 1 --2- 172.21.15.179:0/3698715061 >> v2:172.21.15.179:3300/0 conn(0x7f436806d130 0x7f4368148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.559 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.557+0000 7f4367e00640 1 -- 172.21.15.179:0/3698715061 >> v1:172.21.15.142:6789/0 conn(0x7f436813f600 legacy=0x7f43680744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.559 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.557+0000 7f4367e00640 1 -- 172.21.15.179:0/3698715061 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43680b7be0 con 0x7f436806d5a0 2024-04-01T15:21:35.559 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.558+0000 7f4367e00640 1 --2- 172.21.15.179:0/3698715061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f43681491c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4360009e80 tx=0x7f436002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32bf7e9b2924a128 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:35.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.558+0000 7f4366000640 1 -- 172.21.15.179:0/3698715061 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436002ca50 con 0x7f436806d5a0 2024-04-01T15:21:35.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.558+0000 7f4366000640 1 -- 172.21.15.179:0/3698715061 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f436002cbf0 con 0x7f436806d5a0 2024-04-01T15:21:35.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.558+0000 7f4366000640 1 -- 172.21.15.179:0/3698715061 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600343f0 con 0x7f436806d5a0 2024-04-01T15:21:35.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.559+0000 7f436ca00640 1 -- 172.21.15.179:0/3698715061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 msgr2=0x7f43681491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.559+0000 7f436ca00640 1 --2- 172.21.15.179:0/3698715061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f43681491c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4360009e80 tx=0x7f436002beb0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.559+0000 7f436ca00640 1 -- 172.21.15.179:0/3698715061 shutdown_connections 2024-04-01T15:21:35.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.559+0000 7f436ca00640 1 --2- 172.21.15.179:0/3698715061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f43681491c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.559+0000 7f436ca00640 1 --2- 172.21.15.179:0/3698715061 >> v2:172.21.15.179:3300/0 conn(0x7f436806d130 0x7f4368148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.559+0000 7f436ca00640 1 -- 172.21.15.179:0/3698715061 >> 172.21.15.179:0/3698715061 conn(0x7f43680b9440 msgr2=0x7f43680b9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:35.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.559+0000 7f436ca00640 1 -- 172.21.15.179:0/3698715061 shutdown_connections 2024-04-01T15:21:35.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.559+0000 7f436ca00640 1 -- 172.21.15.179:0/3698715061 wait complete. 2024-04-01T15:21:35.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.560+0000 7f436ca00640 1 Processor -- start 2024-04-01T15:21:35.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.561+0000 7f436ca00640 1 -- start start 2024-04-01T15:21:35.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.561+0000 7f436ca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436806d130 0x7f4368145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.561+0000 7f436ca00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f4368099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.561+0000 7f436ca00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f436813f600 0x7f4368143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.561+0000 7f436ca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f436814feb0 con 0x7f436806d130 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.561+0000 7f436ca00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f436814fd30 con 0x7f436813f600 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.561+0000 7f436ca00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4368150030 con 0x7f436806d5a0 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f436813f600 0x7f4368143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4366a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f4368099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f436813f600 0x7f4368143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:35510/0 (socket says 172.21.15.179:35510) 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367e00640 1 -- 172.21.15.179:0/756141212 learned_addr learned my addr 172.21.15.179:0/756141212 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367400640 1 --2- 172.21.15.179:0/756141212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436806d130 0x7f4368145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367e00640 1 -- 172.21.15.179:0/756141212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 msgr2=0x7f4368099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367e00640 1 --2- 172.21.15.179:0/756141212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f4368099e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367e00640 1 -- 172.21.15.179:0/756141212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436806d130 msgr2=0x7f4368145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367e00640 1 --2- 172.21.15.179:0/756141212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436806d130 0x7f4368145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367e00640 1 -- 172.21.15.179:0/756141212 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43681460e0 con 0x7f436813f600 2024-04-01T15:21:35.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4366a00640 1 --2- 172.21.15.179:0/756141212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f4368099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:21:35.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.562+0000 7f4367e00640 1 --2- 172.21.15.179:0/756141212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f436813f600 0x7f4368143de0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4360036040 tx=0x7f4360004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:35.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.563+0000 7f435f400640 1 -- 172.21.15.179:0/756141212 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4360043020 con 0x7f436813f600 2024-04-01T15:21:35.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.563+0000 7f435f400640 1 -- 172.21.15.179:0/756141212 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f436003e450 con 0x7f436813f600 2024-04-01T15:21:35.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.563+0000 7f436ca00640 1 -- 172.21.15.179:0/756141212 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4368099900 con 0x7f436813f600 2024-04-01T15:21:35.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.563+0000 7f435f400640 1 -- 172.21.15.179:0/756141212 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4360009510 con 0x7f436813f600 2024-04-01T15:21:35.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.563+0000 7f436ca00640 1 -- 172.21.15.179:0/756141212 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43681dcfb0 con 0x7f436813f600 2024-04-01T15:21:35.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.563+0000 7f435f400640 1 -- 172.21.15.179:0/756141212 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4360046020 con 0x7f436813f600 2024-04-01T15:21:35.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.563+0000 7f435f400640 1 -- 172.21.15.179:0/756141212 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f436002ca60 con 0x7f436813f600 2024-04-01T15:21:35.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.564+0000 7f436ca00640 1 -- 172.21.15.179:0/756141212 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4368068ca0 con 0x7f436813f600 2024-04-01T15:21:35.567 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.567+0000 7f435f400640 1 -- 172.21.15.179:0/756141212 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f436004d030 con 0x7f436813f600 2024-04-01T15:21:35.572 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.570+0000 7fa835612040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T15:21:35.626 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:35.624+0000 7fa835612040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T15:21:35.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.644+0000 7f436ca00640 1 -- 172.21.15.179:0/756141212 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc946de0-8ebd-4054-a17b-7386b3255d4f", "id": 3} v 0) -- 0x7f43680b8d50 con 0x7f436813f600 2024-04-01T15:21:35.654 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.653+0000 7f435f400640 1 -- 172.21.15.179:0/756141212 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc946de0-8ebd-4054-a17b-7386b3255d4f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f436003e820 con 0x7f436813f600 2024-04-01T15:21:35.654 INFO:teuthology.orchestra.run.smithi179.stdout:3 2024-04-01T15:21:35.655 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.654+0000 7f436ca00640 1 -- 172.21.15.179:0/756141212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f436813f600 msgr2=0x7f4368143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.654+0000 7f436ca00640 1 --2- 172.21.15.179:0/756141212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f436813f600 0x7f4368143de0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4360036040 tx=0x7f4360004a40 comp rx=0 tx=0).stop 2024-04-01T15:21:35.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.654+0000 7f436ca00640 1 -- 172.21.15.179:0/756141212 shutdown_connections 2024-04-01T15:21:35.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.654+0000 7f436ca00640 1 --2- 172.21.15.179:0/756141212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f436813f600 0x7f4368143de0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.654+0000 7f436ca00640 1 --2- 172.21.15.179:0/756141212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f436806d5a0 0x7f4368099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.654+0000 7f436ca00640 1 --2- 172.21.15.179:0/756141212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436806d130 0x7f4368145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.654+0000 7f436ca00640 1 -- 172.21.15.179:0/756141212 >> 172.21.15.179:0/756141212 conn(0x7f43680b9440 msgr2=0x7f436809d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:35.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.654+0000 7f436ca00640 1 -- 172.21.15.179:0/756141212 shutdown_connections 2024-04-01T15:21:35.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.654+0000 7f436ca00640 1 -- 172.21.15.179:0/756141212 wait complete. 2024-04-01T15:21:35.671 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new da0f028c-23d3-4483-96a4-89c230c68896 4 2024-04-01T15:21:35.904 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.902+0000 7fe82be00640 1 Processor -- start 2024-04-01T15:21:35.904 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.903+0000 7fe82be00640 1 -- start start 2024-04-01T15:21:35.906 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.904+0000 7fe82be00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8240b5080 0x7fe8240b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.906 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.904+0000 7fe82be00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe824148130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.906 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.904+0000 7fe82be00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8240b62e0 con 0x7fe8240b5f00 2024-04-01T15:21:35.906 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.904+0000 7fe82be00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe8240b4bf0 con 0x7fe8240b5080 2024-04-01T15:21:35.906 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.904+0000 7fe82be00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe8240b45a0 con 0x7fe824147ce0 2024-04-01T15:21:35.906 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.905+0000 7fe829400640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe8240b5f00 0x7fe824141630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:49898/0 (socket says 172.21.15.179:49898) 2024-04-01T15:21:35.906 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.905+0000 7fe829400640 1 -- 172.21.15.179:0/1861118096 learned_addr learned my addr 172.21.15.179:0/1861118096 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-01T15:21:35.906 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.905+0000 7fe828a00640 1 --2- 172.21.15.179:0/1861118096 >> v2:172.21.15.179:3300/0 conn(0x7fe8240b5080 0x7fe8240b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.906 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.905+0000 7fe829e00640 1 --2- 172.21.15.179:0/1861118096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe824148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.907 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.905+0000 7fe829e00640 1 -- 172.21.15.179:0/1861118096 >> v2:172.21.15.179:3300/0 conn(0x7fe8240b5080 msgr2=0x7fe8240b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:35.907 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.905+0000 7fe829e00640 1 --2- 172.21.15.179:0/1861118096 >> v2:172.21.15.179:3300/0 conn(0x7fe8240b5080 0x7fe8240b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.907 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.905+0000 7fe829e00640 1 -- 172.21.15.179:0/1861118096 >> v1:172.21.15.179:6789/0 conn(0x7fe8240b5f00 legacy=0x7fe824141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.908 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.905+0000 7fe829e00640 1 -- 172.21.15.179:0/1861118096 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8240b4880 con 0x7fe824147ce0 2024-04-01T15:21:35.908 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.905+0000 7fe828a00640 1 --2- 172.21.15.179:0/1861118096 >> v2:172.21.15.179:3300/0 conn(0x7fe8240b5080 0x7fe8240b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:21:35.908 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.906+0000 7fe829e00640 1 --2- 172.21.15.179:0/1861118096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe824148130 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009d90 tx=0x7fe81c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985920dca596feb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:35.908 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.906+0000 7fe823e00640 1 -- 172.21.15.179:0/1861118096 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c039070 con 0x7fe824147ce0 2024-04-01T15:21:35.908 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.906+0000 7fe823e00640 1 -- 172.21.15.179:0/1861118096 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c02cbc0 con 0x7fe824147ce0 2024-04-01T15:21:35.908 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.906+0000 7fe823e00640 1 -- 172.21.15.179:0/1861118096 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c034440 con 0x7fe824147ce0 2024-04-01T15:21:35.909 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.907+0000 7fe82be00640 1 -- 172.21.15.179:0/1861118096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 msgr2=0x7fe824148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.909 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.907+0000 7fe82be00640 1 --2- 172.21.15.179:0/1861118096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe824148130 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009d90 tx=0x7fe81c02be10 comp rx=0 tx=0).stop 2024-04-01T15:21:35.909 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.907+0000 7fe82be00640 1 -- 172.21.15.179:0/1861118096 shutdown_connections 2024-04-01T15:21:35.909 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.907+0000 7fe82be00640 1 --2- 172.21.15.179:0/1861118096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe824148130 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.909 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.907+0000 7fe82be00640 1 --2- 172.21.15.179:0/1861118096 >> v2:172.21.15.179:3300/0 conn(0x7fe8240b5080 0x7fe8240b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.909 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.907+0000 7fe82be00640 1 -- 172.21.15.179:0/1861118096 >> 172.21.15.179:0/1861118096 conn(0x7fe8240bd100 msgr2=0x7fe8240bd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:35.909 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.907+0000 7fe82be00640 1 -- 172.21.15.179:0/1861118096 shutdown_connections 2024-04-01T15:21:35.909 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.907+0000 7fe82be00640 1 -- 172.21.15.179:0/1861118096 wait complete. 2024-04-01T15:21:35.910 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.909+0000 7fe82be00640 1 Processor -- start 2024-04-01T15:21:35.910 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.909+0000 7fe82be00640 1 -- start start 2024-04-01T15:21:35.912 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe82be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240b5080 0x7fe82413f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.912 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe82be00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8240b5f00 0x7fe824140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.912 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe82be00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe8241dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:35.912 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe82be00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe824141ec0 con 0x7fe8240b5080 2024-04-01T15:21:35.912 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe82be00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe824141d40 con 0x7fe8240b5f00 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe82be00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe824152130 con 0x7fe824147ce0 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe829e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe8241dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe828a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8240b5f00 0x7fe824140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe829e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe8241dd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45270/0 (socket says 172.21.15.179:45270) 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe828a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8240b5f00 0x7fe824140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:35518/0 (socket says 172.21.15.179:35518) 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe829e00640 1 -- 172.21.15.179:0/128583037 learned_addr learned my addr 172.21.15.179:0/128583037 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe829400640 1 --2- 172.21.15.179:0/128583037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240b5080 0x7fe82413f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe829e00640 1 -- 172.21.15.179:0/128583037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8240b5f00 msgr2=0x7fe824140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe829e00640 1 --2- 172.21.15.179:0/128583037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8240b5f00 0x7fe824140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe829e00640 1 -- 172.21.15.179:0/128583037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240b5080 msgr2=0x7fe82413f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe829e00640 1 --2- 172.21.15.179:0/128583037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240b5080 0x7fe82413f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe829e00640 1 -- 172.21.15.179:0/128583037 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe824151da0 con 0x7fe824147ce0 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.910+0000 7fe828a00640 1 --2- 172.21.15.179:0/128583037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8240b5f00 0x7fe824140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:21:35.913 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.911+0000 7fe829e00640 1 --2- 172.21.15.179:0/128583037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe8241dd8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009d90 tx=0x7fe81c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:35.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.911+0000 7fe821600640 1 -- 172.21.15.179:0/128583037 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c039050 con 0x7fe824147ce0 2024-04-01T15:21:35.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.911+0000 7fe821600640 1 -- 172.21.15.179:0/128583037 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c045070 con 0x7fe824147ce0 2024-04-01T15:21:35.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.911+0000 7fe821600640 1 -- 172.21.15.179:0/128583037 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c009450 con 0x7fe824147ce0 2024-04-01T15:21:35.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.911+0000 7fe82be00640 1 -- 172.21.15.179:0/128583037 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82413ffb0 con 0x7fe824147ce0 2024-04-01T15:21:35.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.911+0000 7fe82be00640 1 -- 172.21.15.179:0/128583037 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82413e750 con 0x7fe824147ce0 2024-04-01T15:21:35.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.911+0000 7fe821600640 1 -- 172.21.15.179:0/128583037 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe81c03e850 con 0x7fe824147ce0 2024-04-01T15:21:35.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.911+0000 7fe821600640 1 -- 172.21.15.179:0/128583037 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe81c04a460 con 0x7fe824147ce0 2024-04-01T15:21:35.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.913+0000 7fe82be00640 1 -- 172.21.15.179:0/128583037 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe824068710 con 0x7fe824147ce0 2024-04-01T15:21:35.916 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.915+0000 7fe821600640 1 -- 172.21.15.179:0/128583037 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe81c03eb40 con 0x7fe824147ce0 2024-04-01T15:21:35.942 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:35.941+0000 7f436323c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T15:21:35.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:35.995+0000 7fe82be00640 1 -- 172.21.15.179:0/128583037 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "da0f028c-23d3-4483-96a4-89c230c68896", "id": 4} v 0) -- 0x7fe824147ac0 con 0x7fe824147ce0 2024-04-01T15:21:36.004 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.003+0000 7fe821600640 1 -- 172.21.15.179:0/128583037 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da0f028c-23d3-4483-96a4-89c230c68896", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe81c03ed20 con 0x7fe824147ce0 2024-04-01T15:21:36.005 INFO:teuthology.orchestra.run.smithi179.stdout:4 2024-04-01T15:21:36.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.005+0000 7fe82be00640 1 -- 172.21.15.179:0/128583037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 msgr2=0x7fe8241dd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.005+0000 7fe82be00640 1 --2- 172.21.15.179:0/128583037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe8241dd8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009d90 tx=0x7fe81c004a40 comp rx=0 tx=0).stop 2024-04-01T15:21:36.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.005+0000 7fe82be00640 1 -- 172.21.15.179:0/128583037 shutdown_connections 2024-04-01T15:21:36.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.005+0000 7fe82be00640 1 --2- 172.21.15.179:0/128583037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe824147ce0 0x7fe8241dd8e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.005+0000 7fe82be00640 1 --2- 172.21.15.179:0/128583037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8240b5f00 0x7fe824140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.007 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.005+0000 7fe82be00640 1 --2- 172.21.15.179:0/128583037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240b5080 0x7fe82413f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.007 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.005+0000 7fe82be00640 1 -- 172.21.15.179:0/128583037 >> 172.21.15.179:0/128583037 conn(0x7fe8240bd100 msgr2=0x7fe8240b8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:36.007 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.005+0000 7fe82be00640 1 -- 172.21.15.179:0/128583037 shutdown_connections 2024-04-01T15:21:36.007 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.005+0000 7fe82be00640 1 -- 172.21.15.179:0/128583037 wait complete. 2024-04-01T15:21:36.028 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new dc20a6cd-0fa6-482d-9fe6-5390a1ffe307 5 2024-04-01T15:21:36.070 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:36.068+0000 7fa835612040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T15:21:36.116 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:36.115+0000 7f436323c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T15:21:36.220 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.219+0000 7fc722a00640 1 Processor -- start 2024-04-01T15:21:36.220 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.219+0000 7fc722a00640 1 -- start start 2024-04-01T15:21:36.221 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.220+0000 7fc722a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.222 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.220+0000 7fc722a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc71c141670 0x7fc71c141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.222 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.220+0000 7fc722a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71c0bde40 con 0x7fc71c14b0d0 2024-04-01T15:21:36.222 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.220+0000 7fc722a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fc71c0b5120 con 0x7fc71c141670 2024-04-01T15:21:36.222 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.220+0000 7fc722a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c0b53e0 con 0x7fc71c0bda60 2024-04-01T15:21:36.222 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.220+0000 7fc71be00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.222 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.220+0000 7fc713e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc71c141670 0x7fc71c141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.222 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.220+0000 7fc720a00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc71c14b0d0 0x7fc71c14b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:49914/0 (socket says 172.21.15.179:49914) 2024-04-01T15:21:36.222 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.221+0000 7fc720a00640 1 -- 172.21.15.179:0/4232663416 learned_addr learned my addr 172.21.15.179:0/4232663416 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-01T15:21:36.223 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.221+0000 7fc713e00640 1 -- 172.21.15.179:0/4232663416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 msgr2=0x7fc71c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:36.223 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.221+0000 7fc713e00640 1 --2- 172.21.15.179:0/4232663416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.223 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.221+0000 7fc713e00640 1 -- 172.21.15.179:0/4232663416 >> v1:172.21.15.179:6789/0 conn(0x7fc71c14b0d0 legacy=0x7fc71c14b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.223 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.221+0000 7fc713e00640 1 -- 172.21.15.179:0/4232663416 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c0b56c0 con 0x7fc71c141670 2024-04-01T15:21:36.223 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.221+0000 7fc71b400640 1 -- 172.21.15.179:0/4232663416 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059113232 0 0) 0x7fc71c0bde40 con 0x7fc71c14b0d0 2024-04-01T15:21:36.223 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.221+0000 7fc71be00640 1 --2- 172.21.15.179:0/4232663416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:21:36.223 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.222+0000 7fc713e00640 1 --2- 172.21.15.179:0/4232663416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c141670 0x7fc71c141ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc7040097a0 tx=0x7fc70402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a89dc120f77070b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.222+0000 7fc71b400640 1 -- 172.21.15.179:0/4232663416 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704031780 con 0x7fc71c141670 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.222+0000 7fc71b400640 1 -- 172.21.15.179:0/4232663416 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc704037070 con 0x7fc71c141670 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.222+0000 7fc71b400640 1 -- 172.21.15.179:0/4232663416 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704031b40 con 0x7fc71c141670 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.223+0000 7fc722a00640 1 -- 172.21.15.179:0/4232663416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c141670 msgr2=0x7fc71c141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.223+0000 7fc722a00640 1 --2- 172.21.15.179:0/4232663416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c141670 0x7fc71c141ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc7040097a0 tx=0x7fc70402b820 comp rx=0 tx=0).stop 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.223+0000 7fc722a00640 1 -- 172.21.15.179:0/4232663416 shutdown_connections 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.223+0000 7fc722a00640 1 --2- 172.21.15.179:0/4232663416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c141670 0x7fc71c141ad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.223+0000 7fc722a00640 1 --2- 172.21.15.179:0/4232663416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.223+0000 7fc722a00640 1 -- 172.21.15.179:0/4232663416 >> 172.21.15.179:0/4232663416 conn(0x7fc71c0734b0 msgr2=0x7fc71c0bd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.223+0000 7fc722a00640 1 -- 172.21.15.179:0/4232663416 shutdown_connections 2024-04-01T15:21:36.225 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.224+0000 7fc722a00640 1 -- 172.21.15.179:0/4232663416 wait complete. 2024-04-01T15:21:36.226 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:36.224+0000 7fa835612040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T15:21:36.226 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.225+0000 7fc722a00640 1 Processor -- start 2024-04-01T15:21:36.226 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.225+0000 7fc722a00640 1 -- start start 2024-04-01T15:21:36.228 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc722a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0bba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc722a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71c141670 0x7fc71c13ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc722a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c14b0d0 0x7fc71c0bc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc722a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0b4b40 con 0x7fc71c141670 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc722a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0b49c0 con 0x7fc71c14b0d0 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc722a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c152180 con 0x7fc71c0bda60 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc720a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c14b0d0 0x7fc71c0bc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc71be00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0bba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc71be00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0bba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:45282/0 (socket says 172.21.15.179:45282) 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc71be00640 1 -- 172.21.15.179:0/1837666460 learned_addr learned my addr 172.21.15.179:0/1837666460 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc720a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c14b0d0 0x7fc71c0bc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:35548/0 (socket says 172.21.15.179:35548) 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc713e00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71c141670 0x7fc71c13ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc720a00640 1 -- 172.21.15.179:0/1837666460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 msgr2=0x7fc71c0bba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc720a00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0bba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.229 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc720a00640 1 -- 172.21.15.179:0/1837666460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71c141670 msgr2=0x7fc71c13ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc720a00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71c141670 0x7fc71c13ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc720a00640 1 -- 172.21.15.179:0/1837666460 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c13ec10 con 0x7fc71c14b0d0 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc71be00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0bba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.226+0000 7fc713e00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71c141670 0x7fc71c13ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.227+0000 7fc720a00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c14b0d0 0x7fc71c0bc950 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c780 tx=0x7fc71400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.227+0000 7fc718c00640 1 -- 172.21.15.179:0/1837666460 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714018070 con 0x7fc71c14b0d0 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.227+0000 7fc718c00640 1 -- 172.21.15.179:0/1837666460 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714004d60 con 0x7fc71c14b0d0 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.227+0000 7fc722a00640 1 -- 172.21.15.179:0/1837666460 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c151ed0 con 0x7fc71c14b0d0 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.227+0000 7fc718c00640 1 -- 172.21.15.179:0/1837666460 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71400a880 con 0x7fc71c14b0d0 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.227+0000 7fc722a00640 1 -- 172.21.15.179:0/1837666460 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c13d200 con 0x7fc71c14b0d0 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.227+0000 7fc718c00640 1 -- 172.21.15.179:0/1837666460 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc71400aa20 con 0x7fc71c14b0d0 2024-04-01T15:21:36.230 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.227+0000 7fc718c00640 1 -- 172.21.15.179:0/1837666460 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc71400ad10 con 0x7fc71c14b0d0 2024-04-01T15:21:36.231 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.228+0000 7fc722a00640 1 -- 172.21.15.179:0/1837666460 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71c068710 con 0x7fc71c14b0d0 2024-04-01T15:21:36.232 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.231+0000 7fc718c00640 1 -- 172.21.15.179:0/1837666460 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc714021020 con 0x7fc71c14b0d0 2024-04-01T15:21:36.253 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:36.252+0000 7f436323c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T15:21:36.308 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:36.307+0000 7f436323c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T15:21:36.310 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.309+0000 7fc722a00640 1 -- 172.21.15.179:0/1837666460 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc20a6cd-0fa6-482d-9fe6-5390a1ffe307", "id": 5} v 0) -- 0x7fc71c145220 con 0x7fc71c14b0d0 2024-04-01T15:21:36.317 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.316+0000 7fc718c00640 1 -- 172.21.15.179:0/1837666460 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc20a6cd-0fa6-482d-9fe6-5390a1ffe307", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc7140070d0 con 0x7fc71c14b0d0 2024-04-01T15:21:36.317 INFO:teuthology.orchestra.run.smithi179.stdout:5 2024-04-01T15:21:36.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.317+0000 7fc722a00640 1 -- 172.21.15.179:0/1837666460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c14b0d0 msgr2=0x7fc71c0bc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.317+0000 7fc722a00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c14b0d0 0x7fc71c0bc950 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c780 tx=0x7fc71400cc40 comp rx=0 tx=0).stop 2024-04-01T15:21:36.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.317+0000 7fc722a00640 1 -- 172.21.15.179:0/1837666460 shutdown_connections 2024-04-01T15:21:36.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.317+0000 7fc722a00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c14b0d0 0x7fc71c0bc950 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.317+0000 7fc722a00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc71c141670 0x7fc71c13ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.317+0000 7fc722a00640 1 --2- 172.21.15.179:0/1837666460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0bda60 0x7fc71c0bba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.317+0000 7fc722a00640 1 -- 172.21.15.179:0/1837666460 >> 172.21.15.179:0/1837666460 conn(0x7fc71c0734b0 msgr2=0x7fc71c14a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:36.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.317+0000 7fc722a00640 1 -- 172.21.15.179:0/1837666460 shutdown_connections 2024-04-01T15:21:36.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.317+0000 7fc722a00640 1 -- 172.21.15.179:0/1837666460 wait complete. 2024-04-01T15:21:36.333 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new cab4c5ef-8a70-4acb-b9d8-60f0078cab64 6 2024-04-01T15:21:36.361 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:36.360+0000 7fa835612040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T15:21:36.413 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:36.412+0000 7fa835612040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T15:21:36.442 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:36.441+0000 7f436323c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T15:21:36.513 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.512+0000 7fb02f000640 1 Processor -- start 2024-04-01T15:21:36.513 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.512+0000 7fb02f000640 1 -- start start 2024-04-01T15:21:36.515 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.513+0000 7fb02f000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5080 0x7fb0280b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.515 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.513+0000 7fb02f000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0280b62e0 con 0x7fb028147ce0 2024-04-01T15:21:36.515 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.513+0000 7fb02f000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0280b45a0 con 0x7fb0280b5f00 2024-04-01T15:21:36.515 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.513+0000 7fb02f000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb0280b4bf0 con 0x7fb0280b5080 2024-04-01T15:21:36.515 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.513+0000 7fb027e00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb0280b5f00 0x7fb028141630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:49922/0 (socket says 172.21.15.179:49922) 2024-04-01T15:21:36.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.513+0000 7fb027e00640 1 -- 172.21.15.179:0/150690431 learned_addr learned my addr 172.21.15.179:0/150690431 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-01T15:21:36.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.513+0000 7fb027400640 1 --2- 172.21.15.179:0/150690431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5080 0x7fb0280b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.514+0000 7fb026a00640 1 -- 172.21.15.179:0/150690431 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413324547 0 0) 0x7fb0280b45a0 con 0x7fb0280b5f00 2024-04-01T15:21:36.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.514+0000 7fb026a00640 1 -- 172.21.15.179:0/150690431 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb00c003520 con 0x7fb0280b5f00 2024-04-01T15:21:36.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.514+0000 7fb027400640 1 -- 172.21.15.179:0/150690431 >> v1:172.21.15.179:6789/0 conn(0x7fb0280b5f00 legacy=0x7fb028141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.514+0000 7fb027400640 1 -- 172.21.15.179:0/150690431 >> v1:172.21.15.142:6789/0 conn(0x7fb028147ce0 legacy=0x7fb028148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.514+0000 7fb027400640 1 -- 172.21.15.179:0/150690431 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0280b4880 con 0x7fb0280b5080 2024-04-01T15:21:36.517 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.515+0000 7fb027400640 1 --2- 172.21.15.179:0/150690431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5080 0x7fb0280b54e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb0100097d0 tx=0x7fb01002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9071b575f0f1ce6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:36.517 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.516+0000 7fb026a00640 1 -- 172.21.15.179:0/150690431 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010035020 con 0x7fb0280b5080 2024-04-01T15:21:36.517 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.516+0000 7fb026a00640 1 -- 172.21.15.179:0/150690431 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb010031800 con 0x7fb0280b5080 2024-04-01T15:21:36.517 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.516+0000 7fb026a00640 1 -- 172.21.15.179:0/150690431 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010031bb0 con 0x7fb0280b5080 2024-04-01T15:21:36.518 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.516+0000 7fb02f000640 1 -- 172.21.15.179:0/150690431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5080 msgr2=0x7fb0280b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.518 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.516+0000 7fb02f000640 1 --2- 172.21.15.179:0/150690431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5080 0x7fb0280b54e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb0100097d0 tx=0x7fb01002b8a0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.518 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.516+0000 7fb02f000640 1 -- 172.21.15.179:0/150690431 shutdown_connections 2024-04-01T15:21:36.518 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.516+0000 7fb02f000640 1 --2- 172.21.15.179:0/150690431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5080 0x7fb0280b54e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.518 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.516+0000 7fb02f000640 1 -- 172.21.15.179:0/150690431 >> 172.21.15.179:0/150690431 conn(0x7fb0280bd100 msgr2=0x7fb0280bd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:36.518 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.517+0000 7fb02f000640 1 -- 172.21.15.179:0/150690431 shutdown_connections 2024-04-01T15:21:36.518 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.517+0000 7fb02f000640 1 -- 172.21.15.179:0/150690431 wait complete. 2024-04-01T15:21:36.519 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.518+0000 7fb02f000640 1 Processor -- start 2024-04-01T15:21:36.519 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.519+0000 7fb02f000640 1 -- start start 2024-04-01T15:21:36.522 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb02f000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0280b5080 0x7fb02813bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.522 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb02f000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5f00 0x7fb0281e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb02f000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb028147ce0 0x7fb0281e1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb02f000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb0281532c0 con 0x7fb028147ce0 2024-04-01T15:21:36.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb02f000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb028153140 con 0x7fb0280b5080 2024-04-01T15:21:36.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb02f000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb028153440 con 0x7fb0280b5f00 2024-04-01T15:21:36.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0280b5080 0x7fb02813bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0280b5080 0x7fb02813bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:35558/0 (socket says 172.21.15.179:35558) 2024-04-01T15:21:36.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027e00640 1 -- 172.21.15.179:0/191102235 learned_addr learned my addr 172.21.15.179:0/191102235 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:36.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5f00 0x7fb0281e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb02d000640 1 --2- 172.21.15.179:0/191102235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb028147ce0 0x7fb0281e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027e00640 1 -- 172.21.15.179:0/191102235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5f00 msgr2=0x7fb0281e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027e00640 1 --2- 172.21.15.179:0/191102235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5f00 0x7fb0281e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027e00640 1 -- 172.21.15.179:0/191102235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb028147ce0 msgr2=0x7fb0281e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027e00640 1 --2- 172.21.15.179:0/191102235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb028147ce0 0x7fb0281e1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027e00640 1 -- 172.21.15.179:0/191102235 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0281e0640 con 0x7fb0280b5080 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.520+0000 7fb027400640 1 --2- 172.21.15.179:0/191102235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5f00 0x7fb0281e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.521+0000 7fb027e00640 1 --2- 172.21.15.179:0/191102235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0280b5080 0x7fb02813bff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb01800cbc0 tx=0x7fb01800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.521+0000 7fb01fe00640 1 -- 172.21.15.179:0/191102235 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018017070 con 0x7fb0280b5080 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.521+0000 7fb01fe00640 1 -- 172.21.15.179:0/191102235 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01800ad40 con 0x7fb0280b5080 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.521+0000 7fb01fe00640 1 -- 172.21.15.179:0/191102235 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018012600 con 0x7fb0280b5080 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.521+0000 7fb02f000640 1 -- 172.21.15.179:0/191102235 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb028149e50 con 0x7fb0280b5080 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.521+0000 7fb02f000640 1 -- 172.21.15.179:0/191102235 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb028148970 con 0x7fb0280b5080 2024-04-01T15:21:36.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.521+0000 7fb01fe00640 1 -- 172.21.15.179:0/191102235 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb01801a070 con 0x7fb0280b5080 2024-04-01T15:21:36.525 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.521+0000 7fb01fe00640 1 -- 172.21.15.179:0/191102235 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fb01801c440 con 0x7fb0280b5080 2024-04-01T15:21:36.525 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.522+0000 7fb02f000640 1 -- 172.21.15.179:0/191102235 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb028068710 con 0x7fb0280b5080 2024-04-01T15:21:36.525 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.524+0000 7fb01fe00640 1 -- 172.21.15.179:0/191102235 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb0180127a0 con 0x7fb0280b5080 2024-04-01T15:21:36.540 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:36.539+0000 7fa835612040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T15:21:36.560 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:36.559+0000 7f436323c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T15:21:36.604 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.603+0000 7fb02f000640 1 -- 172.21.15.179:0/191102235 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cab4c5ef-8a70-4acb-b9d8-60f0078cab64", "id": 6} v 0) -- 0x7fb0281451d0 con 0x7fb0280b5080 2024-04-01T15:21:36.615 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.613+0000 7fb01fe00640 1 -- 172.21.15.179:0/191102235 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cab4c5ef-8a70-4acb-b9d8-60f0078cab64", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb018012980 con 0x7fb0280b5080 2024-04-01T15:21:36.615 INFO:teuthology.orchestra.run.smithi179.stdout:6 2024-04-01T15:21:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.615+0000 7fb02f000640 1 -- 172.21.15.179:0/191102235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0280b5080 msgr2=0x7fb02813bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.615+0000 7fb02f000640 1 --2- 172.21.15.179:0/191102235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0280b5080 0x7fb02813bff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb01800cbc0 tx=0x7fb01800a430 comp rx=0 tx=0).stop 2024-04-01T15:21:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.615+0000 7fb02f000640 1 -- 172.21.15.179:0/191102235 shutdown_connections 2024-04-01T15:21:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.615+0000 7fb02f000640 1 --2- 172.21.15.179:0/191102235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb028147ce0 0x7fb0281e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.615+0000 7fb02f000640 1 --2- 172.21.15.179:0/191102235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0280b5f00 0x7fb0281e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.615+0000 7fb02f000640 1 --2- 172.21.15.179:0/191102235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0280b5080 0x7fb02813bff0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.615+0000 7fb02f000640 1 -- 172.21.15.179:0/191102235 >> 172.21.15.179:0/191102235 conn(0x7fb0280bd100 msgr2=0x7fb028138970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.615+0000 7fb02f000640 1 -- 172.21.15.179:0/191102235 shutdown_connections 2024-04-01T15:21:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.615+0000 7fb02f000640 1 -- 172.21.15.179:0/191102235 wait complete. 2024-04-01T15:21:36.632 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new e48039cc-eccf-4f81-8ad6-908308758427 7 2024-04-01T15:21:36.649 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:36.648+0000 7fa835612040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T15:21:36.745 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:36.743+0000 7f436323c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T15:21:36.797 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:36.796+0000 7f436323c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T15:21:36.817 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.816+0000 7ff342e00640 1 Processor -- start 2024-04-01T15:21:36.818 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.817+0000 7ff342e00640 1 -- start start 2024-04-01T15:21:36.820 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.818+0000 7ff342e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff33c14adf0 0x7ff33c14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.820 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.818+0000 7ff342e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33c0b72a0 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.820 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.818+0000 7ff342e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33c0b4690 con 0x7ff33c14ff00 2024-04-01T15:21:36.820 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.818+0000 7ff342e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff33c14b1d0 con 0x7ff33c14adf0 2024-04-01T15:21:36.820 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.819+0000 7ff341a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff33c14adf0 0x7ff33c14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.820 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.819+0000 7ff342400640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff33c14ff00 0x7ff33c1522f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:49926/0 (socket says 172.21.15.179:49926) 2024-04-01T15:21:36.820 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.819+0000 7ff342400640 1 -- 172.21.15.179:0/2318582220 learned_addr learned my addr 172.21.15.179:0/2318582220 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-01T15:21:36.821 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.819+0000 7ff33be00640 1 -- 172.21.15.179:0/2318582220 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211329297 0 0) 0x7ff33c0b4690 con 0x7ff33c14ff00 2024-04-01T15:21:36.821 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.819+0000 7ff341a00640 1 -- 172.21.15.179:0/2318582220 >> v1:172.21.15.179:6789/0 conn(0x7ff33c14ff00 legacy=0x7ff33c1522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.821 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.819+0000 7ff341a00640 1 -- 172.21.15.179:0/2318582220 >> v1:172.21.15.142:6789/0 conn(0x7ff33c0b5aa0 legacy=0x7ff33c1414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:36.821 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.819+0000 7ff341a00640 1 -- 172.21.15.179:0/2318582220 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c14ba20 con 0x7ff33c14adf0 2024-04-01T15:21:36.822 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.820+0000 7ff341a00640 1 --2- 172.21.15.179:0/2318582220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c14adf0 0x7ff33c14b4e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff33c14b3b0 tx=0x7ff33002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97de70cc3a07a7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:36.822 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.820+0000 7ff33be00640 1 -- 172.21.15.179:0/2318582220 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330038070 con 0x7ff33c14adf0 2024-04-01T15:21:36.822 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.820+0000 7ff33be00640 1 -- 172.21.15.179:0/2318582220 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff330031700 con 0x7ff33c14adf0 2024-04-01T15:21:36.822 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.820+0000 7ff33be00640 1 -- 172.21.15.179:0/2318582220 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330031ad0 con 0x7ff33c14adf0 2024-04-01T15:21:36.823 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.821+0000 7ff342e00640 1 -- 172.21.15.179:0/2318582220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c14adf0 msgr2=0x7ff33c14b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.823 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.821+0000 7ff342e00640 1 --2- 172.21.15.179:0/2318582220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c14adf0 0x7ff33c14b4e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff33c14b3b0 tx=0x7ff33002b7a0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.823 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.821+0000 7ff342e00640 1 -- 172.21.15.179:0/2318582220 shutdown_connections 2024-04-01T15:21:36.823 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.821+0000 7ff342e00640 1 --2- 172.21.15.179:0/2318582220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c14adf0 0x7ff33c14b4e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.823 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.821+0000 7ff342e00640 1 -- 172.21.15.179:0/2318582220 >> 172.21.15.179:0/2318582220 conn(0x7ff33c0b9960 msgr2=0x7ff33c0b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:36.823 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.821+0000 7ff342e00640 1 -- 172.21.15.179:0/2318582220 shutdown_connections 2024-04-01T15:21:36.823 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.821+0000 7ff342e00640 1 -- 172.21.15.179:0/2318582220 wait complete. 2024-04-01T15:21:36.824 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:36.821+0000 7fa835612040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.823+0000 7ff342e00640 1 Processor -- start 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.823+0000 7ff342e00640 1 -- start start 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.823+0000 7ff342e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c0b5aa0 0x7ff33c147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.823+0000 7ff342e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c14adf0 0x7ff33c146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff342e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33c14ff00 0x7ff33c1e0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff342e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c0b4d00 con 0x7ff33c14adf0 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff342e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c0b49e0 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff342e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c141c00 con 0x7ff33c14ff00 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c0b5aa0 0x7ff33c147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c0b5aa0 0x7ff33c147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:35580/0 (socket says 172.21.15.179:35580) 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341a00640 1 -- 172.21.15.179:0/3914266114 learned_addr learned my addr 172.21.15.179:0/3914266114 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff342400640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33c14ff00 0x7ff33c1e0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341000640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c14adf0 0x7ff33c146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341a00640 1 -- 172.21.15.179:0/3914266114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33c14ff00 msgr2=0x7ff33c1e0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341a00640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33c14ff00 0x7ff33c1e0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341a00640 1 -- 172.21.15.179:0/3914266114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c14adf0 msgr2=0x7ff33c146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341a00640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c14adf0 0x7ff33c146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341a00640 1 -- 172.21.15.179:0/3914266114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c142aa0 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341000640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c14adf0 0x7ff33c146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.824+0000 7ff341a00640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c0b5aa0 0x7ff33c147b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff330009890 tx=0x7ff3300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.825+0000 7ff339600640 1 -- 172.21.15.179:0/3914266114 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330038040 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.825+0000 7ff339600640 1 -- 172.21.15.179:0/3914266114 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff330033a30 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.825+0000 7ff339600640 1 -- 172.21.15.179:0/3914266114 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330031ed0 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.825+0000 7ff342e00640 1 -- 172.21.15.179:0/3914266114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c1459f0 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.825+0000 7ff342e00640 1 -- 172.21.15.179:0/3914266114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c1469a0 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.825+0000 7ff339600640 1 -- 172.21.15.179:0/3914266114 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff330003610 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.825+0000 7ff339600640 1 -- 172.21.15.179:0/3914266114 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff33003eaa0 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.826+0000 7ff342e00640 1 -- 172.21.15.179:0/3914266114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c068ca0 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.829 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.828+0000 7ff339600640 1 -- 172.21.15.179:0/3914266114 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff330043020 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.871 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:36.870+0000 7fa835612040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T15:21:36.908 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.907+0000 7ff342e00640 1 -- 172.21.15.179:0/3914266114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e48039cc-eccf-4f81-8ad6-908308758427", "id": 7} v 0) -- 0x7ff33c0bc610 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.917 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.916+0000 7ff339600640 1 -- 172.21.15.179:0/3914266114 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e48039cc-eccf-4f81-8ad6-908308758427", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff330030070 con 0x7ff33c0b5aa0 2024-04-01T15:21:36.917 INFO:teuthology.orchestra.run.smithi179.stdout:7 2024-04-01T15:21:36.919 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.918+0000 7ff342e00640 1 -- 172.21.15.179:0/3914266114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c0b5aa0 msgr2=0x7ff33c147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:36.919 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.918+0000 7ff342e00640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c0b5aa0 0x7ff33c147b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff330009890 tx=0x7ff3300046c0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.919 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.918+0000 7ff342e00640 1 -- 172.21.15.179:0/3914266114 shutdown_connections 2024-04-01T15:21:36.919 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.918+0000 7ff342e00640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33c14ff00 0x7ff33c1e0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.919 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.918+0000 7ff342e00640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c14adf0 0x7ff33c146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.919 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.918+0000 7ff342e00640 1 --2- 172.21.15.179:0/3914266114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33c0b5aa0 0x7ff33c147b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:36.920 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.918+0000 7ff342e00640 1 -- 172.21.15.179:0/3914266114 >> 172.21.15.179:0/3914266114 conn(0x7ff33c0b9960 msgr2=0x7ff33c0b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:36.920 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.918+0000 7ff342e00640 1 -- 172.21.15.179:0/3914266114 shutdown_connections 2024-04-01T15:21:36.920 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-01T15:21:36.918+0000 7ff342e00640 1 -- 172.21.15.179:0/3914266114 wait complete. 2024-04-01T15:21:36.934 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-01T15:21:36.934 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-01T15:21:36.940 INFO:tasks.ceph.osd.0:Started 2024-04-01T15:21:36.940 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-01T15:21:36.940 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-01T15:21:36.946 INFO:tasks.ceph.osd.1:Started 2024-04-01T15:21:36.946 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-01T15:21:36.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-01T15:21:36.951 INFO:tasks.ceph.osd.2:Started 2024-04-01T15:21:36.951 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-01T15:21:36.951 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-01T15:21:36.956 INFO:tasks.ceph.osd.3:Started 2024-04-01T15:21:36.956 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-01T15:21:36.956 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-01T15:21:36.963 INFO:tasks.ceph.osd.4:Started 2024-04-01T15:21:36.964 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-01T15:21:36.964 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-01T15:21:36.970 INFO:tasks.ceph.osd.5:Started 2024-04-01T15:21:36.971 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-01T15:21:36.971 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-01T15:21:36.975 INFO:tasks.ceph.osd.6:Started 2024-04-01T15:21:36.975 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-01T15:21:36.975 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-01T15:21:36.981 INFO:tasks.ceph.osd.7:Started 2024-04-01T15:21:36.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:21:36.982 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:36.981+0000 7f436323c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T15:21:37.105 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:37.103+0000 7fa835612040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T15:21:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.203+0000 7f8e10600640 1 Processor -- start 2024-04-01T15:21:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.203+0000 7f8e10600640 1 -- start start 2024-04-01T15:21:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.204+0000 7f8e10600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e080b2d20 0x7f8e081491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.204+0000 7f8e10600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e080b3180 con 0x7f8e08149720 2024-04-01T15:21:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.204+0000 7f8e10600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e0806dcb0 con 0x7f8e0806d8d0 2024-04-01T15:21:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.204+0000 7f8e10600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8e080b0b20 con 0x7f8e080b2d20 2024-04-01T15:21:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.204+0000 7f8e0d200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e080b2d20 0x7f8e081491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.204+0000 7f8e0e600640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8e08149720 0x7f8e0814fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60916/0 (socket says 172.21.15.142:60916) 2024-04-01T15:21:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.204+0000 7f8e0d200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e080b2d20 0x7f8e081491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47536/0 (socket says 172.21.15.142:47536) 2024-04-01T15:21:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.204+0000 7f8e0e600640 1 -- 172.21.15.142:0/2450434948 learned_addr learned my addr 172.21.15.142:0/2450434948 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.205+0000 7f8e0d200640 1 -- 172.21.15.142:0/2450434948 >> v1:172.21.15.179:6789/0 conn(0x7f8e0806d8d0 legacy=0x7f8e080b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.205+0000 7f8e0d200640 1 -- 172.21.15.142:0/2450434948 >> v1:172.21.15.142:6789/0 conn(0x7f8e08149720 legacy=0x7f8e0814fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.205+0000 7f8e0d200640 1 -- 172.21.15.142:0/2450434948 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e08148ad0 con 0x7f8e080b2d20 2024-04-01T15:21:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.205+0000 7f8e07e00640 1 -- 172.21.15.142:0/2450434948 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343081721 0 0) 0x7f8e080b3180 con 0x7f8e08149720 2024-04-01T15:21:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.207+0000 7f8e0d200640 1 --2- 172.21.15.142:0/2450434948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b2d20 0x7f8e081491e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8df40097a0 tx=0x7f8df402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cba483ea0edf55 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.207+0000 7f8e07e00640 1 -- 172.21.15.142:0/2450434948 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4035020 con 0x7f8e080b2d20 2024-04-01T15:21:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.207+0000 7f8e07e00640 1 -- 172.21.15.142:0/2450434948 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df4031830 con 0x7f8e080b2d20 2024-04-01T15:21:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.207+0000 7f8e07e00640 1 -- 172.21.15.142:0/2450434948 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4031c00 con 0x7f8e080b2d20 2024-04-01T15:21:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.207+0000 7f8e10600640 1 -- 172.21.15.142:0/2450434948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b2d20 msgr2=0x7f8e081491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.207+0000 7f8e10600640 1 --2- 172.21.15.142:0/2450434948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b2d20 0x7f8e081491e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8df40097a0 tx=0x7f8df402b8d0 comp rx=0 tx=0).stop 2024-04-01T15:21:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.208+0000 7f8e10600640 1 -- 172.21.15.142:0/2450434948 shutdown_connections 2024-04-01T15:21:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.208+0000 7f8e10600640 1 --2- 172.21.15.142:0/2450434948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b2d20 0x7f8e081491e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.208+0000 7f8e10600640 1 -- 172.21.15.142:0/2450434948 >> 172.21.15.142:0/2450434948 conn(0x7f8e080b5890 msgr2=0x7f8e080b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.208+0000 7f8e10600640 1 -- 172.21.15.142:0/2450434948 shutdown_connections 2024-04-01T15:21:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.208+0000 7f8e10600640 1 -- 172.21.15.142:0/2450434948 wait complete. 2024-04-01T15:21:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.209+0000 7f8e10600640 1 Processor -- start 2024-04-01T15:21:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.209+0000 7f8e10600640 1 -- start start 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e10600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0806d8d0 0x7f8e081d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e10600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e080b2d20 0x7f8e081d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e10600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e08149720 0x7f8e081db0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e10600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8e080b16c0 con 0x7f8e0806d8d0 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e10600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8e080b5510 con 0x7f8e08149720 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e10600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8e080b4e50 con 0x7f8e080b2d20 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e0dc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0806d8d0 0x7f8e081d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e0dc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0806d8d0 0x7f8e081d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47538/0 (socket says 172.21.15.142:47538) 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e0dc00640 1 -- 172.21.15.142:0/3518991411 learned_addr learned my addr 172.21.15.142:0/3518991411 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e0d200640 1 --2- 172.21.15.142:0/3518991411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e080b2d20 0x7f8e081d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.210+0000 7f8e0e600640 1 --2- 172.21.15.142:0/3518991411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e08149720 0x7f8e081db0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e0dc00640 1 -- 172.21.15.142:0/3518991411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e080b2d20 msgr2=0x7f8e081d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e0dc00640 1 --2- 172.21.15.142:0/3518991411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e080b2d20 0x7f8e081d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e0dc00640 1 -- 172.21.15.142:0/3518991411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e08149720 msgr2=0x7f8e081db0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e0dc00640 1 --2- 172.21.15.142:0/3518991411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e08149720 0x7f8e081db0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e0dc00640 1 -- 172.21.15.142:0/3518991411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e081ce9c0 con 0x7f8e0806d8d0 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e0dc00640 1 --2- 172.21.15.142:0/3518991411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0806d8d0 0x7f8e081d04a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00c450 tx=0x7f8dfc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e05600640 1 -- 172.21.15.142:0/3518991411 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0052d0 con 0x7f8e0806d8d0 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e05600640 1 -- 172.21.15.142:0/3518991411 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc005470 con 0x7f8e0806d8d0 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e10600640 1 -- 172.21.15.142:0/3518991411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e081438f0 con 0x7f8e0806d8d0 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e05600640 1 -- 172.21.15.142:0/3518991411 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc012870 con 0x7f8e0806d8d0 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e10600640 1 -- 172.21.15.142:0/3518991411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e08143570 con 0x7f8e0806d8d0 2024-04-01T15:21:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.211+0000 7f8e05600640 1 -- 172.21.15.142:0/3518991411 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8dfc012a10 con 0x7f8e0806d8d0 2024-04-01T15:21:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.212+0000 7f8e05600640 1 -- 172.21.15.142:0/3518991411 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8dfc012d00 con 0x7f8e0806d8d0 2024-04-01T15:21:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.212+0000 7f8e10600640 1 -- 172.21.15.142:0/3518991411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e081d1720 con 0x7f8e0806d8d0 2024-04-01T15:21:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.215+0000 7f8e05600640 1 -- 172.21.15.142:0/3518991411 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8e081d1720 con 0x7f8e0806d8d0 2024-04-01T15:21:37.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.279+0000 7f8e10600640 1 -- 172.21.15.142:0/3518991411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e08068710 con 0x7f8e0806d8d0 2024-04-01T15:21:37.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.280+0000 7f8e05600640 1 -- 172.21.15.142:0/3518991411 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8dfc0035f0 con 0x7f8e0806d8d0 2024-04-01T15:21:37.281 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:21:37.282 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":10,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:36.909239+0000","last_up_change":"0.000000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:21:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.281+0000 7f8e10600640 1 -- 172.21.15.142:0/3518991411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0806d8d0 msgr2=0x7f8e081d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.281+0000 7f8e10600640 1 --2- 172.21.15.142:0/3518991411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0806d8d0 0x7f8e081d04a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00c450 tx=0x7f8dfc00c910 comp rx=0 tx=0).stop 2024-04-01T15:21:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.281+0000 7f8e10600640 1 -- 172.21.15.142:0/3518991411 shutdown_connections 2024-04-01T15:21:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.281+0000 7f8e10600640 1 --2- 172.21.15.142:0/3518991411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e08149720 0x7f8e081db0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.281+0000 7f8e10600640 1 --2- 172.21.15.142:0/3518991411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e080b2d20 0x7f8e081d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.281+0000 7f8e10600640 1 --2- 172.21.15.142:0/3518991411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0806d8d0 0x7f8e081d04a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.281+0000 7f8e10600640 1 -- 172.21.15.142:0/3518991411 >> 172.21.15.142:0/3518991411 conn(0x7f8e080b5890 msgr2=0x7f8e080b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.281+0000 7f8e10600640 1 -- 172.21.15.142:0/3518991411 shutdown_connections 2024-04-01T15:21:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:37.281+0000 7f8e10600640 1 -- 172.21.15.142:0/3518991411 wait complete. 2024-04-01T15:21:37.297 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-01T15:21:37.297 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-01T15:21:37.636 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-04-01T15:21:37.635+0000 7f3a7f611640 -1 Falling back to public interface 2024-04-01T15:21:37.655 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-04-01T15:21:37.653+0000 7f440fe13640 -1 Falling back to public interface 2024-04-01T15:21:37.663 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-01T15:21:37.662+0000 7f1d11806640 -1 Falling back to public interface 2024-04-01T15:21:37.664 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-01T15:21:37.663+0000 7f475300c640 -1 Falling back to public interface 2024-04-01T15:21:37.672 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-01T15:21:37.671+0000 7f7b2c4f9640 -1 Falling back to public interface 2024-04-01T15:21:37.676 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-04-01T15:21:37.674+0000 7fe222ddf640 -1 Falling back to public interface 2024-04-01T15:21:37.678 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-01T15:21:37.676+0000 7f6db1412640 -1 Falling back to public interface 2024-04-01T15:21:37.678 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-01T15:21:37.677+0000 7fa8de8f9640 -1 Falling back to public interface 2024-04-01T15:21:38.035 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:38.034+0000 7f436323c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T15:21:38.103 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T15:21:38.200 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:38.198+0000 7fa835612040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T15:21:38.256 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.255+0000 7f6c9b400640 1 Processor -- start 2024-04-01T15:21:38.256 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.255+0000 7f6c9b400640 1 -- start start 2024-04-01T15:21:38.257 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.256+0000 7f6c9b400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c940b6240 0x7f6c941410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:38.258 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.256+0000 7f6c9b400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c940b46c0 con 0x7f6c940b5760 2024-04-01T15:21:38.258 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.256+0000 7f6c9b400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c94147a10 con 0x7f6c940b5380 2024-04-01T15:21:38.258 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.256+0000 7f6c9b400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6c940b4b10 con 0x7f6c940b6240 2024-04-01T15:21:38.258 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.256+0000 7f6c93e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c940b6240 0x7f6c941410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:38.258 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.256+0000 7f6c99400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6c940b5760 0x7f6c941415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60924/0 (socket says 172.21.15.142:60924) 2024-04-01T15:21:38.258 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.256+0000 7f6c99400640 1 -- 172.21.15.142:0/126444902 learned_addr learned my addr 172.21.15.142:0/126444902 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:38.259 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.257+0000 7f6c93e00640 1 -- 172.21.15.142:0/126444902 >> v1:172.21.15.179:6789/0 conn(0x7f6c940b5380 legacy=0x7f6c94148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:38.259 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.257+0000 7f6c93e00640 1 -- 172.21.15.142:0/126444902 >> v1:172.21.15.142:6789/0 conn(0x7f6c940b5760 legacy=0x7f6c941415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:38.259 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.257+0000 7f6c93e00640 1 -- 172.21.15.142:0/126444902 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c94141d00 con 0x7f6c940b6240 2024-04-01T15:21:38.259 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.257+0000 7f6c93400640 1 -- 172.21.15.142:0/126444902 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190568748 0 0) 0x7f6c940b46c0 con 0x7f6c940b5760 2024-04-01T15:21:38.260 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.258+0000 7f6c93e00640 1 --2- 172.21.15.142:0/126444902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b6240 0x7f6c941410b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c800097c0 tx=0x7f6c8002b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d9567056125735 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:38.260 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.258+0000 7f6c93400640 1 -- 172.21.15.142:0/126444902 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c80031770 con 0x7f6c940b6240 2024-04-01T15:21:38.260 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.258+0000 7f6c93400640 1 -- 172.21.15.142:0/126444902 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c80037070 con 0x7f6c940b6240 2024-04-01T15:21:38.260 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.258+0000 7f6c93400640 1 -- 172.21.15.142:0/126444902 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c80031b30 con 0x7f6c940b6240 2024-04-01T15:21:38.260 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.259+0000 7f6c9b400640 1 -- 172.21.15.142:0/126444902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b6240 msgr2=0x7f6c941410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:38.260 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.259+0000 7f6c9b400640 1 --2- 172.21.15.142:0/126444902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b6240 0x7f6c941410b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c800097c0 tx=0x7f6c8002b810 comp rx=0 tx=0).stop 2024-04-01T15:21:38.260 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.259+0000 7f6c9b400640 1 -- 172.21.15.142:0/126444902 shutdown_connections 2024-04-01T15:21:38.260 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.259+0000 7f6c9b400640 1 --2- 172.21.15.142:0/126444902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b6240 0x7f6c941410b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:38.261 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.259+0000 7f6c9b400640 1 -- 172.21.15.142:0/126444902 >> 172.21.15.142:0/126444902 conn(0x7f6c940b9b30 msgr2=0x7f6c940b9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:38.261 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.259+0000 7f6c9b400640 1 -- 172.21.15.142:0/126444902 shutdown_connections 2024-04-01T15:21:38.261 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.259+0000 7f6c9b400640 1 -- 172.21.15.142:0/126444902 wait complete. 2024-04-01T15:21:38.262 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.260+0000 7f6c9b400640 1 Processor -- start 2024-04-01T15:21:38.262 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.260+0000 7f6c9b400640 1 -- start start 2024-04-01T15:21:38.264 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c9b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b5380 0x7f6c94143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:38.264 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c9b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940b5760 0x7f6c94144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:38.264 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c9b400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941420f0 0x7f6c941427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:38.264 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c9b400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c94147d80 con 0x7f6c940b5380 2024-04-01T15:21:38.264 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c9b400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940b7c40 con 0x7f6c941420f0 2024-04-01T15:21:38.264 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c9b400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c940b71b0 con 0x7f6c940b5760 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c98a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b5380 0x7f6c94143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c98a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b5380 0x7f6c94143a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47556/0 (socket says 172.21.15.142:47556) 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c98a00640 1 -- 172.21.15.142:0/3546881133 learned_addr learned my addr 172.21.15.142:0/3546881133 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c93e00640 1 --2- 172.21.15.142:0/3546881133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940b5760 0x7f6c94144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.261+0000 7f6c99400640 1 --2- 172.21.15.142:0/3546881133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941420f0 0x7f6c941427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.262+0000 7f6c98a00640 1 -- 172.21.15.142:0/3546881133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940b5760 msgr2=0x7f6c94144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.262+0000 7f6c98a00640 1 --2- 172.21.15.142:0/3546881133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940b5760 0x7f6c94144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.262+0000 7f6c98a00640 1 -- 172.21.15.142:0/3546881133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941420f0 msgr2=0x7f6c941427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.262+0000 7f6c98a00640 1 --2- 172.21.15.142:0/3546881133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941420f0 0x7f6c941427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.262+0000 7f6c98a00640 1 -- 172.21.15.142:0/3546881133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c94144090 con 0x7f6c940b5380 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.262+0000 7f6c98a00640 1 --2- 172.21.15.142:0/3546881133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b5380 0x7f6c94143a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c480 tx=0x7f6c8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.262+0000 7f6c90c00640 1 -- 172.21.15.142:0/3546881133 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c880052d0 con 0x7f6c940b5380 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.262+0000 7f6c90c00640 1 -- 172.21.15.142:0/3546881133 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c88005470 con 0x7f6c940b5380 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.262+0000 7f6c90c00640 1 -- 172.21.15.142:0/3546881133 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88012870 con 0x7f6c940b5380 2024-04-01T15:21:38.265 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.263+0000 7f6c9b400640 1 -- 172.21.15.142:0/3546881133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9413d500 con 0x7f6c940b5380 2024-04-01T15:21:38.266 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.263+0000 7f6c9b400640 1 -- 172.21.15.142:0/3546881133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c94142d10 con 0x7f6c940b5380 2024-04-01T15:21:38.266 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.263+0000 7f6c90c00640 1 -- 172.21.15.142:0/3546881133 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c88012a10 con 0x7f6c940b5380 2024-04-01T15:21:38.266 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.263+0000 7f6c90c00640 1 -- 172.21.15.142:0/3546881133 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6c88012d00 con 0x7f6c940b5380 2024-04-01T15:21:38.266 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.264+0000 7f6c9b400640 1 -- 172.21.15.142:0/3546881133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c94068ec0 con 0x7f6c940b5380 2024-04-01T15:21:38.267 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.266+0000 7f6c90c00640 1 -- 172.21.15.142:0/3546881133 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6c880035f0 con 0x7f6c940b5380 2024-04-01T15:21:38.332 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.330+0000 7f6c9b400640 1 -- 172.21.15.142:0/3546881133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c94140880 con 0x7f6c940b5380 2024-04-01T15:21:38.333 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.331+0000 7f6c90c00640 1 -- 172.21.15.142:0/3546881133 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6c880037d0 con 0x7f6c940b5380 2024-04-01T15:21:38.333 INFO:teuthology.misc.health.smithi142.stdout: 2024-04-01T15:21:38.333 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":10,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:36.909239+0000","last_up_change":"0.000000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:21:38.334 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.333+0000 7f6c9b400640 1 -- 172.21.15.142:0/3546881133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b5380 msgr2=0x7f6c94143a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:38.334 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.333+0000 7f6c9b400640 1 --2- 172.21.15.142:0/3546881133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b5380 0x7f6c94143a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c480 tx=0x7f6c8800c940 comp rx=0 tx=0).stop 2024-04-01T15:21:38.335 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.333+0000 7f6c9b400640 1 -- 172.21.15.142:0/3546881133 shutdown_connections 2024-04-01T15:21:38.335 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.333+0000 7f6c9b400640 1 --2- 172.21.15.142:0/3546881133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941420f0 0x7f6c941427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:38.335 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.333+0000 7f6c9b400640 1 --2- 172.21.15.142:0/3546881133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940b5760 0x7f6c94144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:38.335 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.333+0000 7f6c9b400640 1 --2- 172.21.15.142:0/3546881133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c940b5380 0x7f6c94143a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:38.335 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.333+0000 7f6c9b400640 1 -- 172.21.15.142:0/3546881133 >> 172.21.15.142:0/3546881133 conn(0x7f6c940b9b30 msgr2=0x7f6c9413fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:38.335 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.333+0000 7f6c9b400640 1 -- 172.21.15.142:0/3546881133 shutdown_connections 2024-04-01T15:21:38.335 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:38.333+0000 7f6c9b400640 1 -- 172.21.15.142:0/3546881133 wait complete. 2024-04-01T15:21:38.345 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:38.344+0000 7f436323c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T15:21:38.346 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-01T15:21:38.403 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:38.402+0000 7f436323c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T15:21:38.533 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:38.531+0000 7fa835612040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T15:21:38.534 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:38.534+0000 7f436323c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T15:21:38.600 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:38.598+0000 7fa835612040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T15:21:38.728 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-04-01T15:21:38.727+0000 7fa835612040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T15:21:39.575 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:39.574+0000 7f4303c00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-01T15:21:39.579 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-01T15:21:39.578+0000 7f4303c00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-01T15:21:40.982 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-01T15:21:40.981+0000 7fa8de8f9640 -1 osd.5 0 log_to_monitors true 2024-04-01T15:21:41.181 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-04-01T15:21:41.180+0000 7f3a7f611640 -1 osd.3 0 log_to_monitors true 2024-04-01T15:21:41.247 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-04-01T15:21:41.245+0000 7fe222ddf640 -1 osd.1 0 log_to_monitors true 2024-04-01T15:21:41.248 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-01T15:21:41.247+0000 7f6db1412640 -1 osd.4 0 log_to_monitors true 2024-04-01T15:21:41.256 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-01T15:21:41.255+0000 7f1d11806640 -1 osd.6 0 log_to_monitors true 2024-04-01T15:21:41.260 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-01T15:21:41.259+0000 7f475300c640 -1 osd.7 0 log_to_monitors true 2024-04-01T15:21:41.491 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-04-01T15:21:41.489+0000 7f440fe13640 -1 osd.0 0 log_to_monitors true 2024-04-01T15:21:41.522 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-01T15:21:41.521+0000 7f7b2c4f9640 -1 osd.2 0 log_to_monitors true 2024-04-01T15:21:44.823 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-01T15:21:44.822+0000 7f1d0c600640 -1 osd.6 0 waiting for initial osdmap 2024-04-01T15:21:44.835 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-01T15:21:44.834+0000 7f1d02600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T15:21:44.884 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-01T15:21:44.883+0000 7f474e200640 -1 osd.7 0 waiting for initial osdmap 2024-04-01T15:21:44.892 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-01T15:21:44.889+0000 7f4743800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T15:21:44.893 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-01T15:21:44.892+0000 7f6dac600640 -1 osd.4 0 waiting for initial osdmap 2024-04-01T15:21:44.905 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-01T15:21:44.904+0000 7f6da1c00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T15:21:44.913 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-01T15:21:44.912+0000 7fa8d9800640 -1 osd.5 0 waiting for initial osdmap 2024-04-01T15:21:44.924 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-01T15:21:44.923+0000 7fa8cf800640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T15:21:45.127 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-04-01T15:21:45.126+0000 7f3a79e00640 -1 osd.3 0 waiting for initial osdmap 2024-04-01T15:21:45.134 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-04-01T15:21:45.133+0000 7f3a6fe00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T15:21:45.151 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T15:21:45.169 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-04-01T15:21:45.168+0000 7f440a600640 -1 osd.0 0 waiting for initial osdmap 2024-04-01T15:21:45.172 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-04-01T15:21:45.171+0000 7fe21dc00640 -1 osd.1 0 waiting for initial osdmap 2024-04-01T15:21:45.178 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-04-01T15:21:45.176+0000 7fe213c00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T15:21:45.187 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-04-01T15:21:45.186+0000 7f4400600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T15:21:45.233 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-01T15:21:45.232+0000 7f7b27400640 -1 osd.2 0 waiting for initial osdmap 2024-04-01T15:21:45.240 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-01T15:21:45.239+0000 7f7b1d400640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T15:21:45.305 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.304+0000 7f20a1800640 1 Processor -- start 2024-04-01T15:21:45.306 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.304+0000 7f20a1800640 1 -- start start 2024-04-01T15:21:45.307 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.305+0000 7f20a1800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f209c0b5180 0x7f209c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:45.307 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.305+0000 7f20a1800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c0b07e0 con 0x7f209c0b1010 2024-04-01T15:21:45.307 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.305+0000 7f20a1800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c06dcb0 con 0x7f209c06d8d0 2024-04-01T15:21:45.308 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.305+0000 7f20a1800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f209c0b1560 con 0x7f209c0b5180 2024-04-01T15:21:45.308 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.305+0000 7f2092000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f209c0b5180 0x7f209c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:45.308 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.305+0000 7f209b400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f209c0b1010 0x7f209c14ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54006/0 (socket says 172.21.15.142:54006) 2024-04-01T15:21:45.308 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.305+0000 7f209b400640 1 -- 172.21.15.142:0/1375117112 learned_addr learned my addr 172.21.15.142:0/1375117112 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:45.308 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.306+0000 7f2092000640 1 -- 172.21.15.142:0/1375117112 >> v1:172.21.15.179:6789/0 conn(0x7f209c06d8d0 legacy=0x7f209c148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:45.308 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.306+0000 7f2092000640 1 -- 172.21.15.142:0/1375117112 >> v1:172.21.15.142:6789/0 conn(0x7f209c0b1010 legacy=0x7f209c14ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:45.308 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.306+0000 7f2092000640 1 -- 172.21.15.142:0/1375117112 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c09ed20 con 0x7f209c0b5180 2024-04-01T15:21:45.308 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.306+0000 7f209a000640 1 -- 172.21.15.142:0/1375117112 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465578668 0 0) 0x7f209c0b07e0 con 0x7f209c0b1010 2024-04-01T15:21:45.309 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.307+0000 7f2092000640 1 --2- 172.21.15.142:0/1375117112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b5180 0x7f209c0b2090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20840097a0 tx=0x7f208402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f53440b4a22924 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:45.309 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.307+0000 7f209a000640 1 -- 172.21.15.142:0/1375117112 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20840315a0 con 0x7f209c0b5180 2024-04-01T15:21:45.309 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.307+0000 7f209a000640 1 -- 172.21.15.142:0/1375117112 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2084037070 con 0x7f209c0b5180 2024-04-01T15:21:45.309 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.307+0000 7f209a000640 1 -- 172.21.15.142:0/1375117112 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084031960 con 0x7f209c0b5180 2024-04-01T15:21:45.309 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.307+0000 7f20a1800640 1 -- 172.21.15.142:0/1375117112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b5180 msgr2=0x7f209c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:45.310 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.307+0000 7f20a1800640 1 --2- 172.21.15.142:0/1375117112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b5180 0x7f209c0b2090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20840097a0 tx=0x7f208402b840 comp rx=0 tx=0).stop 2024-04-01T15:21:45.310 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.308+0000 7f20a1800640 1 -- 172.21.15.142:0/1375117112 shutdown_connections 2024-04-01T15:21:45.310 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.308+0000 7f20a1800640 1 --2- 172.21.15.142:0/1375117112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b5180 0x7f209c0b2090 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:45.310 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.308+0000 7f20a1800640 1 -- 172.21.15.142:0/1375117112 >> 172.21.15.142:0/1375117112 conn(0x7f209c0b58d0 msgr2=0x7f209c0b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:45.310 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.308+0000 7f20a1800640 1 -- 172.21.15.142:0/1375117112 shutdown_connections 2024-04-01T15:21:45.310 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.308+0000 7f20a1800640 1 -- 172.21.15.142:0/1375117112 wait complete. 2024-04-01T15:21:45.310 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.309+0000 7f20a1800640 1 Processor -- start 2024-04-01T15:21:45.310 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.309+0000 7f20a1800640 1 -- start start 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f20a1800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c06d8d0 0x7f209c13a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f20a1800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b1010 0x7f209c1db020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f20a1800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c1db560 0x7f209c1de590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f20a1800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f209c1489e0 con 0x7f209c0b1010 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f20a1800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f209c148860 con 0x7f209c06d8d0 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f20a1800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f209c0b25d0 con 0x7f209c1db560 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f2092000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b1010 0x7f209c1db020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f2092000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b1010 0x7f209c1db020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51294/0 (socket says 172.21.15.142:51294) 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f2092000640 1 -- 172.21.15.142:0/3611717615 learned_addr learned my addr 172.21.15.142:0/3611717615 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.310+0000 7f209aa00640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c06d8d0 0x7f209c13a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f2092000640 1 -- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c1db560 msgr2=0x7f209c1de590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f209b400640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c1db560 0x7f209c1de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f2092000640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c1db560 0x7f209c1de590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:45.313 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f2092000640 1 -- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c06d8d0 msgr2=0x7f209c13a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:45.314 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f2092000640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c06d8d0 0x7f209c13a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:45.314 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f2092000640 1 -- 172.21.15.142:0/3611717615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c145650 con 0x7f209c0b1010 2024-04-01T15:21:45.314 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f209aa00640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c06d8d0 0x7f209c13a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:45.314 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f2092000640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b1010 0x7f209c1db020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f20840097a0 tx=0x7f20840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:45.314 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f2093400640 1 -- 172.21.15.142:0/3611717615 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084032840 con 0x7f209c0b1010 2024-04-01T15:21:45.314 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f2093400640 1 -- 172.21.15.142:0/3611717615 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20840329e0 con 0x7f209c0b1010 2024-04-01T15:21:45.314 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f2093400640 1 -- 172.21.15.142:0/3611717615 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084032dd0 con 0x7f209c0b1010 2024-04-01T15:21:45.314 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c13c860 con 0x7f209c0b1010 2024-04-01T15:21:45.314 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.311+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c1447b0 con 0x7f209c0b1010 2024-04-01T15:21:45.315 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.312+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c068ec0 con 0x7f209c0b1010 2024-04-01T15:21:45.315 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.313+0000 7f2093400640 1 -- 172.21.15.142:0/3611717615 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f208404c020 con 0x7f209c0b1010 2024-04-01T15:21:45.315 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.314+0000 7f2093400640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f207806c890 0x7f207806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:45.315 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.314+0000 7f2093400640 1 -- 172.21.15.142:0/3611717615 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f208402f020 con 0x7f209c0b1010 2024-04-01T15:21:45.316 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.315+0000 7f209aa00640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f207806c890 0x7f207806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:45.317 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.315+0000 7f209aa00640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f207806c890 0x7f207806ed50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f208c004520 tx=0x7f208c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:45.320 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.319+0000 7f2093400640 1 -- 172.21.15.142:0/3611717615 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2084040070 con 0x7f209c0b1010 2024-04-01T15:21:45.506 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.505+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f209c0b60c0 con 0x7f209c0b1010 2024-04-01T15:21:45.507 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.505+0000 7f2093400640 1 -- 172.21.15.142:0/3611717615 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f208407b600 con 0x7f209c0b1010 2024-04-01T15:21:45.507 INFO:teuthology.misc.health.smithi142.stdout: 2024-04-01T15:21:45.507 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":12,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:42.581983+0000","last_up_change":"0.000000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:21:45.510 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f207806c890 msgr2=0x7f207806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:45.510 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f207806c890 0x7f207806ed50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f208c004520 tx=0x7f208c009040 comp rx=0 tx=0).stop 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b1010 msgr2=0x7f209c1db020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b1010 0x7f209c1db020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f20840097a0 tx=0x7f20840046c0 comp rx=0 tx=0).stop 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 shutdown_connections 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f207806c890 0x7f207806ed50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c1db560 0x7f209c1de590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f209c0b1010 0x7f209c1db020 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 --2- 172.21.15.142:0/3611717615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c06d8d0 0x7f209c13a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 >> 172.21.15.142:0/3611717615 conn(0x7f209c0b58d0 msgr2=0x7f209c0b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 shutdown_connections 2024-04-01T15:21:45.511 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:45.508+0000 7f20a1800640 1 -- 172.21.15.142:0/3611717615 wait complete. 2024-04-01T15:21:45.524 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-01T15:21:50.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:21:50.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:21:52.330 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T15:21:52.515 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.513+0000 7f3f3d000640 1 Processor -- start 2024-04-01T15:21:52.515 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.513+0000 7f3f3d000640 1 -- start start 2024-04-01T15:21:52.516 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.514+0000 7f3f3d000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f38149640 0x7f3f3806d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.514+0000 7f3f3d000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f380b02d0 0x7f3f3814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.514+0000 7f3f3d000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f380b0bd0 con 0x7f3f380b5430 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.514+0000 7f3f3d000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3f38149a20 con 0x7f3f38149640 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.514+0000 7f3f3d000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3f380b1920 con 0x7f3f380b02d0 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.514+0000 7f3f35e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f38149640 0x7f3f3806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.515+0000 7f3f35e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f38149640 0x7f3f3806d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51302/0 (socket says 172.21.15.142:51302) 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.515+0000 7f3f35e00640 1 -- 172.21.15.142:0/2618901866 learned_addr learned my addr 172.21.15.142:0/2618901866 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.515+0000 7f3f2d400640 1 --1- 172.21.15.142:0/2618901866 >> v1:172.21.15.142:6789/0 conn(0x7f3f380b5430 0x7f3f380b1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54016/0 (socket says 172.21.15.142:54016) 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.515+0000 7f3f36800640 1 --2- 172.21.15.142:0/2618901866 >> v2:172.21.15.179:3300/0 conn(0x7f3f380b02d0 0x7f3f3814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.515+0000 7f3f35e00640 1 -- 172.21.15.142:0/2618901866 >> v2:172.21.15.179:3300/0 conn(0x7f3f380b02d0 msgr2=0x7f3f3814fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.515+0000 7f3f35e00640 1 --2- 172.21.15.142:0/2618901866 >> v2:172.21.15.179:3300/0 conn(0x7f3f380b02d0 0x7f3f3814fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.517 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.515+0000 7f3f35e00640 1 -- 172.21.15.142:0/2618901866 >> v1:172.21.15.142:6789/0 conn(0x7f3f380b5430 legacy=0x7f3f380b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.518 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.515+0000 7f3f35e00640 1 -- 172.21.15.142:0/2618901866 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f380b0eb0 con 0x7f3f38149640 2024-04-01T15:21:52.518 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.515+0000 7f3f35400640 1 -- 172.21.15.142:0/2618901866 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 257216594 0 0) 0x7f3f380b0bd0 con 0x7f3f380b5430 2024-04-01T15:21:52.519 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.516+0000 7f3f35e00640 1 --2- 172.21.15.142:0/2618901866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f38149640 0x7f3f3806d660 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f380b27d0 tx=0x7f3f2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5fb6f9224fb327 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:52.519 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.516+0000 7f3f35400640 1 -- 172.21.15.142:0/2618901866 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28035020 con 0x7f3f38149640 2024-04-01T15:21:52.519 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.517+0000 7f3f35400640 1 -- 172.21.15.142:0/2618901866 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f28031870 con 0x7f3f38149640 2024-04-01T15:21:52.519 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.517+0000 7f3f35400640 1 -- 172.21.15.142:0/2618901866 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28031c40 con 0x7f3f38149640 2024-04-01T15:21:52.519 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.517+0000 7f3f3d000640 1 -- 172.21.15.142:0/2618901866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f38149640 msgr2=0x7f3f3806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.519 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.517+0000 7f3f3d000640 1 --2- 172.21.15.142:0/2618901866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f38149640 0x7f3f3806d660 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f380b27d0 tx=0x7f3f2802b910 comp rx=0 tx=0).stop 2024-04-01T15:21:52.520 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.517+0000 7f3f3d000640 1 -- 172.21.15.142:0/2618901866 shutdown_connections 2024-04-01T15:21:52.520 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.517+0000 7f3f3d000640 1 --2- 172.21.15.142:0/2618901866 >> v2:172.21.15.179:3300/0 conn(0x7f3f380b02d0 0x7f3f3814fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.520 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.517+0000 7f3f3d000640 1 --2- 172.21.15.142:0/2618901866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f38149640 0x7f3f3806d660 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.520 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.517+0000 7f3f3d000640 1 -- 172.21.15.142:0/2618901866 >> 172.21.15.142:0/2618901866 conn(0x7f3f380b58d0 msgr2=0x7f3f380b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:52.520 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.517+0000 7f3f3d000640 1 -- 172.21.15.142:0/2618901866 shutdown_connections 2024-04-01T15:21:52.520 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.518+0000 7f3f3d000640 1 -- 172.21.15.142:0/2618901866 wait complete. 2024-04-01T15:21:52.521 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.519+0000 7f3f3d000640 1 Processor -- start 2024-04-01T15:21:52.521 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.519+0000 7f3f3d000640 1 -- start start 2024-04-01T15:21:52.523 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.520+0000 7f3f3d000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f380b02d0 0x7f3f38140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.523 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.520+0000 7f3f3d000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f380b5430 0x7f3f380af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.523 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.520+0000 7f3f3d000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f38149640 0x7f3f381444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.523 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.520+0000 7f3f3d000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3806dba0 con 0x7f3f380b02d0 2024-04-01T15:21:52.523 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.520+0000 7f3f3d000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f380b2dd0 con 0x7f3f38149640 2024-04-01T15:21:52.523 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.520+0000 7f3f3d000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3806dd20 con 0x7f3f380b5430 2024-04-01T15:21:52.523 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.520+0000 7f3f35e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f380b02d0 0x7f3f38140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.523 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.520+0000 7f3f35e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f380b02d0 0x7f3f38140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51308/0 (socket says 172.21.15.142:51308) 2024-04-01T15:21:52.523 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.520+0000 7f3f35e00640 1 -- 172.21.15.142:0/3747129388 learned_addr learned my addr 172.21.15.142:0/3747129388 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f35e00640 1 -- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f380b5430 msgr2=0x7f3f380af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f36800640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f38149640 0x7f3f381444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f35e00640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f380b5430 0x7f3f380af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f35e00640 1 -- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f38149640 msgr2=0x7f3f381444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f35e00640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f38149640 0x7f3f381444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f35e00640 1 -- 172.21.15.142:0/3747129388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f38141280 con 0x7f3f380b02d0 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f35e00640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f380b02d0 0x7f3f38140c20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3f28000c00 tx=0x7f3f280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f2ea00640 1 -- 172.21.15.142:0/3747129388 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28040070 con 0x7f3f380b02d0 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f2ea00640 1 -- 172.21.15.142:0/3747129388 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f28030d00 con 0x7f3f380b02d0 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f38140130 con 0x7f3f380b02d0 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f2ea00640 1 -- 172.21.15.142:0/3747129388 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28035040 con 0x7f3f380b02d0 2024-04-01T15:21:52.524 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.521+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f38143050 con 0x7f3f380b02d0 2024-04-01T15:21:52.525 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.523+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f38068ec0 con 0x7f3f380b02d0 2024-04-01T15:21:52.525 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.524+0000 7f3f2ea00640 1 -- 172.21.15.142:0/3747129388 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f2804b060 con 0x7f3f380b02d0 2024-04-01T15:21:52.526 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.524+0000 7f3f2ea00640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3f1406c8f0 0x7f3f1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.526 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.525+0000 7f3f2ea00640 1 -- 172.21.15.142:0/3747129388 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3f280ad600 con 0x7f3f380b02d0 2024-04-01T15:21:52.526 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.525+0000 7f3f2d400640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3f1406c8f0 0x7f3f1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.527 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.526+0000 7f3f2d400640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3f1406c8f0 0x7f3f1406edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f20007fd0 tx=0x7f3f20007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:52.531 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.530+0000 7f3f2ea00640 1 -- 172.21.15.142:0/3747129388 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3f2807bd70 con 0x7f3f380b02d0 2024-04-01T15:21:52.731 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.729+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f380b86d0 con 0x7f3f380b02d0 2024-04-01T15:21:52.732 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.731+0000 7f3f2ea00640 1 -- 172.21.15.142:0/3747129388 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7f3f2807b670 con 0x7f3f380b02d0 2024-04-01T15:21:52.732 INFO:teuthology.misc.health.smithi142.stdout: 2024-04-01T15:21:52.733 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":16,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:48.870146+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3f1406c8f0 msgr2=0x7f3f1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3f1406c8f0 0x7f3f1406edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f20007fd0 tx=0x7f3f20007920 comp rx=0 tx=0).stop 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f380b02d0 msgr2=0x7f3f38140c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f380b02d0 0x7f3f38140c20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3f28000c00 tx=0x7f3f280046c0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 shutdown_connections 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3f1406c8f0 0x7f3f1406edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f38149640 0x7f3f381444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f380b5430 0x7f3f380af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 --2- 172.21.15.142:0/3747129388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f380b02d0 0x7f3f38140c20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 >> 172.21.15.142:0/3747129388 conn(0x7f3f380b58d0 msgr2=0x7f3f380b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:52.736 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 shutdown_connections 2024-04-01T15:21:52.737 INFO:teuthology.misc.health.smithi142.stderr:2024-04-01T15:21:52.734+0000 7f3f3d000640 1 -- 172.21.15.142:0/3747129388 wait complete. 2024-04-01T15:21:52.749 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-01T15:21:52.750 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-01T15:21:52.750 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-01T15:21:52.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-01T15:21:52.755 INFO:tasks.ceph.mds.a:Started 2024-04-01T15:21:52.755 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-01T15:21:52.755 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-01T15:21:52.762 INFO:tasks.ceph.mds.b:Started 2024-04-01T15:21:52.763 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-01T15:21:52.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:21:52.909 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2024-04-01T15:21:52.951 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-04-01T15:21:52.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.951+0000 7f9caf200640 1 Processor -- start 2024-04-01T15:21:52.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.951+0000 7f9caf200640 1 -- start start 2024-04-01T15:21:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.952+0000 7f9caf200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9cb00b5be0 0x7f9cb00af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.952+0000 7f9caf200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb00aeb60 con 0x7f9cb00afbe0 2024-04-01T15:21:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.952+0000 7f9caf200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb00b5fc0 con 0x7f9cb00af080 2024-04-01T15:21:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.952+0000 7f9caf200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb00b5610 con 0x7f9cb00b5be0 2024-04-01T15:21:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.953+0000 7f9cae800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9cb00afbe0 0x7f9cb00ae450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54026/0 (socket says 172.21.15.142:54026) 2024-04-01T15:21:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.953+0000 7f9cae800640 1 -- 172.21.15.142:0/3784204160 learned_addr learned my addr 172.21.15.142:0/3784204160 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.953+0000 7f9cade00640 1 --2- 172.21.15.142:0/3784204160 >> v2:172.21.15.179:3300/0 conn(0x7f9cb00b5be0 0x7f9cb00af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.953+0000 7f9cad400640 1 -- 172.21.15.142:0/3784204160 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816330728 0 0) 0x7f9cb00aeb60 con 0x7f9cb00afbe0 2024-04-01T15:21:52.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.953+0000 7f9cad400640 1 -- 172.21.15.142:0/3784204160 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c94005730 con 0x7f9cb00afbe0 2024-04-01T15:21:52.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.953+0000 7f9cade00640 1 -- 172.21.15.142:0/3784204160 >> v1:172.21.15.179:6789/0 conn(0x7f9cb00af080 legacy=0x7f9cb00add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.953+0000 7f9cade00640 1 -- 172.21.15.142:0/3784204160 >> v1:172.21.15.142:6789/0 conn(0x7f9cb00afbe0 legacy=0x7f9cb00ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.953+0000 7f9cade00640 1 -- 172.21.15.142:0/3784204160 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb00b1510 con 0x7f9cb00b5be0 2024-04-01T15:21:52.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.954+0000 7f9cade00640 1 --2- 172.21.15.142:0/3784204160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb00b5be0 0x7f9cb00af6a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00097a0 tx=0x7f9ca002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85cb5f54be9420b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:52.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9cad400640 1 -- 172.21.15.142:0/3784204160 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00315a0 con 0x7f9cb00b5be0 2024-04-01T15:21:52.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9cad400640 1 -- 172.21.15.142:0/3784204160 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca0037070 con 0x7f9cb00b5be0 2024-04-01T15:21:52.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9cad400640 1 -- 172.21.15.142:0/3784204160 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0031960 con 0x7f9cb00b5be0 2024-04-01T15:21:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9caf200640 1 -- 172.21.15.142:0/3784204160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb00b5be0 msgr2=0x7f9cb00af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9caf200640 1 --2- 172.21.15.142:0/3784204160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb00b5be0 0x7f9cb00af6a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00097a0 tx=0x7f9ca002b840 comp rx=0 tx=0).stop 2024-04-01T15:21:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9caf200640 1 -- 172.21.15.142:0/3784204160 shutdown_connections 2024-04-01T15:21:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9caf200640 1 --2- 172.21.15.142:0/3784204160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb00b5be0 0x7f9cb00af6a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9caf200640 1 -- 172.21.15.142:0/3784204160 >> 172.21.15.142:0/3784204160 conn(0x7f9cb006c710 msgr2=0x7f9cb006cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9caf200640 1 -- 172.21.15.142:0/3784204160 shutdown_connections 2024-04-01T15:21:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.955+0000 7f9caf200640 1 -- 172.21.15.142:0/3784204160 wait complete. 2024-04-01T15:21:52.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.957+0000 7f9caf200640 1 Processor -- start 2024-04-01T15:21:52.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.957+0000 7f9caf200640 1 -- start start 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9caf200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00af080 0x7f9cb00b9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9caf200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb00afbe0 0x7f9cb00b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9caf200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb00b5be0 0x7f9cb00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9caf200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb00b4e10 con 0x7f9cb00af080 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9caf200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb00b1230 con 0x7f9cb00b5be0 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9caf200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb00b50f0 con 0x7f9cb00afbe0 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9cade00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00af080 0x7f9cb00b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9cade00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00af080 0x7f9cb00b9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51334/0 (socket says 172.21.15.142:51334) 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9ca7e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb00afbe0 0x7f9cb00b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9cae800640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb00b5be0 0x7f9cb00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.958+0000 7f9cade00640 1 -- 172.21.15.142:0/3441476993 learned_addr learned my addr 172.21.15.142:0/3441476993 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:52.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9cade00640 1 -- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb00afbe0 msgr2=0x7f9cb00b8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9cade00640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb00afbe0 0x7f9cb00b8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9cade00640 1 -- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb00b5be0 msgr2=0x7f9cb00b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:52.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9cade00640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb00b5be0 0x7f9cb00b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:52.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9cade00640 1 -- 172.21.15.142:0/3441476993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb006fab0 con 0x7f9cb00af080 2024-04-01T15:21:52.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9cade00640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00af080 0x7f9cb00b9430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0034040 tx=0x7f9ca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:52.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9ca6000640 1 -- 172.21.15.142:0/3441476993 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0032630 con 0x7f9cb00af080 2024-04-01T15:21:52.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9ca6000640 1 -- 172.21.15.142:0/3441476993 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca00327f0 con 0x7f9cb00af080 2024-04-01T15:21:52.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9ca6000640 1 -- 172.21.15.142:0/3441476993 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0032be0 con 0x7f9cb00af080 2024-04-01T15:21:52.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb006fd90 con 0x7f9cb00af080 2024-04-01T15:21:52.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.959+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb0144390 con 0x7f9cb00af080 2024-04-01T15:21:52.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.961+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb0068590 con 0x7f9cb00af080 2024-04-01T15:21:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.962+0000 7f9ca6000640 1 -- 172.21.15.142:0/3441476993 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ca004e430 con 0x7f9cb00af080 2024-04-01T15:21:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.963+0000 7f9ca6000640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9c8c06c920 0x7f9c8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.963+0000 7f9ca6000640 1 -- 172.21.15.142:0/3441476993 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9ca002f030 con 0x7f9cb00af080 2024-04-01T15:21:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.963+0000 7f9ca7e00640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9c8c06c920 0x7f9c8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:52.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.964+0000 7f9ca7e00640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9c8c06c920 0x7f9c8c06ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0072d50 tx=0x7f9c98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:52.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:52.967+0000 7f9ca6000640 1 -- 172.21.15.142:0/3441476993 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9ca0040070 con 0x7f9cb00af080 2024-04-01T15:21:53.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.157+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9cb00b2920 con 0x7f9cb00af080 2024-04-01T15:21:53.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.158+0000 7f9ca6000640 1 -- 172.21.15.142:0/3441476993 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7f9ca007b660 con 0x7f9cb00af080 2024-04-01T15:21:53.160 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:21:53.160 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":16,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:48.870146+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9c8c06c920 msgr2=0x7f9c8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9c8c06c920 0x7f9c8c06ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0072d50 tx=0x7f9c98009040 comp rx=0 tx=0).stop 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00af080 msgr2=0x7f9cb00b9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00af080 0x7f9cb00b9430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0034040 tx=0x7f9ca00046c0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 shutdown_connections 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9c8c06c920 0x7f9c8c06ede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb00b5be0 0x7f9cb00b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb00afbe0 0x7f9cb00b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 --2- 172.21.15.142:0/3441476993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00af080 0x7f9cb00b9430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.160+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 >> 172.21.15.142:0/3441476993 conn(0x7f9cb006c710 msgr2=0x7f9cb013cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:53.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.161+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 shutdown_connections 2024-04-01T15:21:53.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.161+0000 7f9caf200640 1 -- 172.21.15.142:0/3441476993 wait complete. 2024-04-01T15:21:53.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T15:21:46.589606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T15:21:53.180 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T15:21:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.383+0000 7f0edbe00640 1 Processor -- start 2024-04-01T15:21:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.383+0000 7f0edbe00640 1 -- start start 2024-04-01T15:21:53.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.384+0000 7f0edbe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0edc148ba0 0x7f0edc149340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.384+0000 7f0edbe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0edc0b5080 0x7f0edc14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.384+0000 7f0edbe00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0edc142dd0 con 0x7f0edc0718f0 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.384+0000 7f0edbe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0edc149880 con 0x7f0edc0b5080 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.384+0000 7f0edbe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f0edc0b68b0 con 0x7f0edc148ba0 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.385+0000 7f0edb400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0edc0b5080 0x7f0edc14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.385+0000 7f0edb400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0edc0b5080 0x7f0edc14fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51350/0 (socket says 172.21.15.142:51350) 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.385+0000 7f0edb400640 1 -- 172.21.15.142:0/3276744036 learned_addr learned my addr 172.21.15.142:0/3276744036 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.385+0000 7f0edaa00640 1 --2- 172.21.15.142:0/3276744036 >> v2:172.21.15.179:3300/0 conn(0x7f0edc148ba0 0x7f0edc149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.385+0000 7f0edb400640 1 -- 172.21.15.142:0/3276744036 >> v2:172.21.15.179:3300/0 conn(0x7f0edc148ba0 msgr2=0x7f0edc149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.385+0000 7f0edb400640 1 --2- 172.21.15.142:0/3276744036 >> v2:172.21.15.179:3300/0 conn(0x7f0edc148ba0 0x7f0edc149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.385+0000 7f0edb400640 1 -- 172.21.15.142:0/3276744036 >> v1:172.21.15.179:6789/0 conn(0x7f0edc0718f0 legacy=0x7f0edc0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:53.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.385+0000 7f0edb400640 1 -- 172.21.15.142:0/3276744036 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc148f80 con 0x7f0edc0b5080 2024-04-01T15:21:53.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.386+0000 7f0edb400640 1 --2- 172.21.15.142:0/3276744036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 0x7f0edc14fcc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0714b0 tx=0x7f0ed402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd46be53e9dbd637 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:53.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0ed9600640 1 -- 172.21.15.142:0/3276744036 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4038070 con 0x7f0edc0b5080 2024-04-01T15:21:53.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0ed9600640 1 -- 172.21.15.142:0/3276744036 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed402f050 con 0x7f0edc0b5080 2024-04-01T15:21:53.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0ed9600640 1 -- 172.21.15.142:0/3276744036 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4031970 con 0x7f0edc0b5080 2024-04-01T15:21:53.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0edbe00640 1 -- 172.21.15.142:0/3276744036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 msgr2=0x7f0edc14fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0edbe00640 1 --2- 172.21.15.142:0/3276744036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 0x7f0edc14fcc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0714b0 tx=0x7f0ed402b7f0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0edbe00640 1 -- 172.21.15.142:0/3276744036 shutdown_connections 2024-04-01T15:21:53.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0edbe00640 1 --2- 172.21.15.142:0/3276744036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 0x7f0edc14fcc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0edbe00640 1 --2- 172.21.15.142:0/3276744036 >> v2:172.21.15.179:3300/0 conn(0x7f0edc148ba0 0x7f0edc149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0edbe00640 1 -- 172.21.15.142:0/3276744036 >> 172.21.15.142:0/3276744036 conn(0x7f0edc0744b0 msgr2=0x7f0edc0748c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:53.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0edbe00640 1 -- 172.21.15.142:0/3276744036 shutdown_connections 2024-04-01T15:21:53.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.387+0000 7f0edbe00640 1 -- 172.21.15.142:0/3276744036 wait complete. 2024-04-01T15:21:53.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.389+0000 7f0edbe00640 1 Processor -- start 2024-04-01T15:21:53.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.390+0000 7f0edbe00640 1 -- start start 2024-04-01T15:21:53.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.390+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0edc0718f0 0x7f0edc1dc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.390+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 0x7f0edc140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0edc148ba0 0x7f0edc138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0edbe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc0b7350 con 0x7f0edc0b5080 2024-04-01T15:21:53.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0edbe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc0b7070 con 0x7f0edc148ba0 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0edbe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0edc0752c0 con 0x7f0edc0718f0 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0eda000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 0x7f0edc140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0eda000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 0x7f0edc140ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51352/0 (socket says 172.21.15.142:51352) 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0eda000640 1 -- 172.21.15.142:0/3304551336 learned_addr learned my addr 172.21.15.142:0/3304551336 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0edaa00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0edc0718f0 0x7f0edc1dc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0edb400640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0edc148ba0 0x7f0edc138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0eda000640 1 -- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0edc0718f0 msgr2=0x7f0edc1dc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0eda000640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0edc0718f0 0x7f0edc1dc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0eda000640 1 -- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0edc148ba0 msgr2=0x7f0edc138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0eda000640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0edc148ba0 0x7f0edc138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0eda000640 1 -- 172.21.15.142:0/3304551336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc1dcef0 con 0x7f0edc0b5080 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0edb400640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0edc148ba0 0x7f0edc138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:53.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.391+0000 7f0edaa00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0edc0718f0 0x7f0edc1dc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:53.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.392+0000 7f0eda000640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 0x7f0edc140ca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800c400 tx=0x7f0ec800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:53.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.392+0000 7f0ed2a00640 1 -- 172.21.15.142:0/3304551336 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8011790 con 0x7f0edc0b5080 2024-04-01T15:21:53.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.392+0000 7f0ed2a00640 1 -- 172.21.15.142:0/3304551336 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec8017070 con 0x7f0edc0b5080 2024-04-01T15:21:53.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.392+0000 7f0ed2a00640 1 -- 172.21.15.142:0/3304551336 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8011bb0 con 0x7f0edc0b5080 2024-04-01T15:21:53.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.392+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0edc1405a0 con 0x7f0edc0b5080 2024-04-01T15:21:53.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.392+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0edc1dc1b0 con 0x7f0edc0b5080 2024-04-01T15:21:53.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.393+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0edc068ca0 con 0x7f0edc0b5080 2024-04-01T15:21:53.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.394+0000 7f0ed2a00640 1 -- 172.21.15.142:0/3304551336 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ec801c460 con 0x7f0edc0b5080 2024-04-01T15:21:53.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.395+0000 7f0ed2a00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0ebc06c920 0x7f0ebc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.395+0000 7f0ed2a00640 1 -- 172.21.15.142:0/3304551336 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0ec808b660 con 0x7f0edc0b5080 2024-04-01T15:21:53.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.395+0000 7f0edaa00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0ebc06c920 0x7f0ebc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.396+0000 7f0edaa00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0ebc06c920 0x7f0ebc06ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009f50 tx=0x7f0ecc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:53.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.400+0000 7f0ed2a00640 1 -- 172.21.15.142:0/3304551336 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0ec8059dd0 con 0x7f0edc0b5080 2024-04-01T15:21:53.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.599+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0edc1462e0 con 0x7f0edc0b5080 2024-04-01T15:21:53.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.600+0000 7f0ed2a00640 1 -- 172.21.15.142:0/3304551336 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f0ec80596d0 con 0x7f0edc0b5080 2024-04-01T15:21:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2024-04-01T15:21:53.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0ebc06c920 msgr2=0x7f0ebc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0ebc06c920 0x7f0ebc06ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009f50 tx=0x7f0ecc00b040 comp rx=0 tx=0).stop 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 msgr2=0x7f0edc140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 0x7f0edc140ca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800c400 tx=0x7f0ec800c8c0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 shutdown_connections 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0ebc06c920 0x7f0ebc06ede0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0edc148ba0 0x7f0edc138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc0b5080 0x7f0edc140ca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 --2- 172.21.15.142:0/3304551336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0edc0718f0 0x7f0edc1dc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 >> 172.21.15.142:0/3304551336 conn(0x7f0edc0744b0 msgr2=0x7f0edc0b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 shutdown_connections 2024-04-01T15:21:53.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.603+0000 7f0edbe00640 1 -- 172.21.15.142:0/3304551336 wait complete. 2024-04-01T15:21:53.622 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T15:21:53.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.829+0000 7f5b92a00640 1 Processor -- start 2024-04-01T15:21:53.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.830+0000 7f5b92a00640 1 -- start start 2024-04-01T15:21:53.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.831+0000 7f5b92a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b8c06d8d0 0x7f5b8c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.831+0000 7f5b92a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0b0fb0 0x7f5b8c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.831+0000 7f5b92a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8c06dcb0 con 0x7f5b8c149720 2024-04-01T15:21:53.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.831+0000 7f5b92a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5b8c0b0b20 con 0x7f5b8c06d8d0 2024-04-01T15:21:53.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.831+0000 7f5b92a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8c148ad0 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.831+0000 7f5b8be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b8c06d8d0 0x7f5b8c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.831+0000 7f5b8be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b8c06d8d0 0x7f5b8c0b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51360/0 (socket says 172.21.15.142:51360) 2024-04-01T15:21:53.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.831+0000 7f5b8be00640 1 -- 172.21.15.142:0/477101622 learned_addr learned my addr 172.21.15.142:0/477101622 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:53.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.832+0000 7f5b8be00640 1 -- 172.21.15.142:0/477101622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0b0fb0 msgr2=0x7f5b8c1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:53.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.832+0000 7f5b83400640 1 --2- 172.21.15.142:0/477101622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0b0fb0 0x7f5b8c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.832+0000 7f5b8be00640 1 --2- 172.21.15.142:0/477101622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0b0fb0 0x7f5b8c1491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.832+0000 7f5b8be00640 1 -- 172.21.15.142:0/477101622 >> v1:172.21.15.179:6789/0 conn(0x7f5b8c149720 legacy=0x7f5b8c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:53.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.832+0000 7f5b8be00640 1 -- 172.21.15.142:0/477101622 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c0b5230 con 0x7f5b8c06d8d0 2024-04-01T15:21:53.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.833+0000 7f5b8be00640 1 --2- 172.21.15.142:0/477101622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c06d8d0 0x7f5b8c0b2d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009e50 tx=0x7f5b7c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1dda0ae73506ac server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:53.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.833+0000 7f5b8b400640 1 -- 172.21.15.142:0/477101622 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c02ca70 con 0x7f5b8c06d8d0 2024-04-01T15:21:53.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.833+0000 7f5b8b400640 1 -- 172.21.15.142:0/477101622 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c02cc10 con 0x7f5b8c06d8d0 2024-04-01T15:21:53.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.833+0000 7f5b8b400640 1 -- 172.21.15.142:0/477101622 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0343f0 con 0x7f5b8c06d8d0 2024-04-01T15:21:53.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.834+0000 7f5b92a00640 1 -- 172.21.15.142:0/477101622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c06d8d0 msgr2=0x7f5b8c0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.834+0000 7f5b92a00640 1 --2- 172.21.15.142:0/477101622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c06d8d0 0x7f5b8c0b2d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009e50 tx=0x7f5b7c02bed0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.834+0000 7f5b92a00640 1 -- 172.21.15.142:0/477101622 shutdown_connections 2024-04-01T15:21:53.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.834+0000 7f5b92a00640 1 --2- 172.21.15.142:0/477101622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0b0fb0 0x7f5b8c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.834+0000 7f5b92a00640 1 --2- 172.21.15.142:0/477101622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c06d8d0 0x7f5b8c0b2d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.834+0000 7f5b92a00640 1 -- 172.21.15.142:0/477101622 >> 172.21.15.142:0/477101622 conn(0x7f5b8c0b5890 msgr2=0x7f5b8c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:53.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.834+0000 7f5b92a00640 1 -- 172.21.15.142:0/477101622 shutdown_connections 2024-04-01T15:21:53.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.834+0000 7f5b92a00640 1 -- 172.21.15.142:0/477101622 wait complete. 2024-04-01T15:21:53.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.835+0000 7f5b92a00640 1 Processor -- start 2024-04-01T15:21:53.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.836+0000 7f5b92a00640 1 -- start start 2024-04-01T15:21:53.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.836+0000 7f5b92a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c06d8d0 0x7f5b8c0af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.836+0000 7f5b92a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c0b0fb0 0x7f5b8c140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.836+0000 7f5b92a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c149720 0x7f5b8c1455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.836+0000 7f5b92a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c0b4fd0 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.836+0000 7f5b92a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c0b4e50 con 0x7f5b8c06d8d0 2024-04-01T15:21:53.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.836+0000 7f5b92a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8c09edc0 con 0x7f5b8c149720 2024-04-01T15:21:53.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b83400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c0b0fb0 0x7f5b8c140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b83400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c0b0fb0 0x7f5b8c140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51374/0 (socket says 172.21.15.142:51374) 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b83400640 1 -- 172.21.15.142:0/119137306 learned_addr learned my addr 172.21.15.142:0/119137306 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b8be00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c06d8d0 0x7f5b8c0af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b90a00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c149720 0x7f5b8c1455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b83400640 1 -- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c149720 msgr2=0x7f5b8c1455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b83400640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c149720 0x7f5b8c1455d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b83400640 1 -- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c06d8d0 msgr2=0x7f5b8c0af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b83400640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c06d8d0 0x7f5b8c0af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b83400640 1 -- 172.21.15.142:0/119137306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c142de0 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b8be00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c06d8d0 0x7f5b8c0af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b83400640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c0b0fb0 0x7f5b8c140730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400c7f0 tx=0x7f5b7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b88c00640 1 -- 172.21.15.142:0/119137306 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74015070 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b88c00640 1 -- 172.21.15.142:0/119137306 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b74004240 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b88c00640 1 -- 172.21.15.142:0/119137306 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74007620 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.837+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c142300 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.838+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c1428c0 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.839+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8c068710 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.839+0000 7f5b88c00640 1 -- 172.21.15.142:0/119137306 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b740079d0 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.841+0000 7f5b88c00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5b6806c8f0 0x7f5b6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:53.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.841+0000 7f5b88c00640 1 -- 172.21.15.142:0/119137306 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5b7408bc20 con 0x7f5b8c0b0fb0 2024-04-01T15:21:53.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.841+0000 7f5b8be00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5b6806c8f0 0x7f5b6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:53.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.842+0000 7f5b8be00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5b6806c8f0 0x7f5b6806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c035000 tx=0x7f5b7c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:53.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:53.846+0000 7f5b88c00640 1 -- 172.21.15.142:0/119137306 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5b7405a390 con 0x7f5b8c0b0fb0 2024-04-01T15:21:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.084+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b8c141a60 con 0x7f5b8c0b0fb0 2024-04-01T15:21:54.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.085+0000 7f5b88c00640 1 -- 172.21.15.142:0/119137306 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2222 (secure 0 0 0) 0x7f5b74059c90 con 0x7f5b8c0b0fb0 2024-04-01T15:21:54.087 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:21:54.087 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1407766362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1407766362},{"type":"v1","addr":"172.21.15.142:6833","nonce":1407766362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1191595510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1191595510},{"type":"v1","addr":"172.21.15.179:6835","nonce":1191595510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-01T15:21:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 3 2024-04-01T15:21:54.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.087+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5b6806c8f0 msgr2=0x7f5b6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.087+0000 7f5b92a00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5b6806c8f0 0x7f5b6806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c035000 tx=0x7f5b7c030000 comp rx=0 tx=0).stop 2024-04-01T15:21:54.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.087+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c0b0fb0 msgr2=0x7f5b8c140730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.087+0000 7f5b92a00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c0b0fb0 0x7f5b8c140730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400c7f0 tx=0x7f5b7400ccb0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.088+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 shutdown_connections 2024-04-01T15:21:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.088+0000 7f5b92a00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5b6806c8f0 0x7f5b6806edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.088+0000 7f5b92a00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c149720 0x7f5b8c1455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.088+0000 7f5b92a00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b8c0b0fb0 0x7f5b8c140730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.088+0000 7f5b92a00640 1 --2- 172.21.15.142:0/119137306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c06d8d0 0x7f5b8c0af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.088+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 >> 172.21.15.142:0/119137306 conn(0x7f5b8c0b5890 msgr2=0x7f5b8c13ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.088+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 shutdown_connections 2024-04-01T15:21:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.088+0000 7f5b92a00640 1 -- 172.21.15.142:0/119137306 wait complete. 2024-04-01T15:21:54.109 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:21:54.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.316+0000 7f0565c00640 1 Processor -- start 2024-04-01T15:21:54.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.316+0000 7f0565c00640 1 -- start start 2024-04-01T15:21:54.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.317+0000 7f0565c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f05600b5970 0x7f05600ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f0565c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05600b4dd0 con 0x7f05600b5d50 2024-04-01T15:21:54.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f0565c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05600b0190 con 0x7f05600aee60 2024-04-01T15:21:54.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f0565c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f05600b5090 con 0x7f05600b5970 2024-04-01T15:21:54.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f055fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f05600b5970 0x7f05600ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f0565200640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f05600b5d50 0x7f05601477f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54030/0 (socket says 172.21.15.142:54030) 2024-04-01T15:21:54.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f0565200640 1 -- 172.21.15.142:0/279283519 learned_addr learned my addr 172.21.15.142:0/279283519 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:54.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f055fe00640 1 -- 172.21.15.142:0/279283519 >> v1:172.21.15.179:6789/0 conn(0x7f05600aee60 legacy=0x7f05600b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:54.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f055fe00640 1 -- 172.21.15.142:0/279283519 >> v1:172.21.15.142:6789/0 conn(0x7f05600b5d50 legacy=0x7f05601477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f055fe00640 1 -- 172.21.15.142:0/279283519 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05600b5370 con 0x7f05600b5970 2024-04-01T15:21:54.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.318+0000 7f055ea00640 1 -- 172.21.15.142:0/279283519 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682529193 0 0) 0x7f05600b4dd0 con 0x7f05600b5d50 2024-04-01T15:21:54.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.319+0000 7f055fe00640 1 --2- 172.21.15.142:0/279283519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5970 0x7f05600ae920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05500097a0 tx=0x7f055002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7541b2cc037dd37d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:54.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.320+0000 7f055ea00640 1 -- 172.21.15.142:0/279283519 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05500315a0 con 0x7f05600b5970 2024-04-01T15:21:54.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.320+0000 7f055ea00640 1 -- 172.21.15.142:0/279283519 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0550037070 con 0x7f05600b5970 2024-04-01T15:21:54.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.320+0000 7f055ea00640 1 -- 172.21.15.142:0/279283519 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550031960 con 0x7f05600b5970 2024-04-01T15:21:54.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.320+0000 7f0565c00640 1 -- 172.21.15.142:0/279283519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5970 msgr2=0x7f05600ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.320+0000 7f0565c00640 1 --2- 172.21.15.142:0/279283519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5970 0x7f05600ae920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05500097a0 tx=0x7f055002b840 comp rx=0 tx=0).stop 2024-04-01T15:21:54.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.320+0000 7f0565c00640 1 -- 172.21.15.142:0/279283519 shutdown_connections 2024-04-01T15:21:54.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.320+0000 7f0565c00640 1 --2- 172.21.15.142:0/279283519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5970 0x7f05600ae920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.320+0000 7f0565c00640 1 -- 172.21.15.142:0/279283519 >> 172.21.15.142:0/279283519 conn(0x7f056006c710 msgr2=0x7f056006cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:54.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.321+0000 7f0565c00640 1 -- 172.21.15.142:0/279283519 shutdown_connections 2024-04-01T15:21:54.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.321+0000 7f0565c00640 1 -- 172.21.15.142:0/279283519 wait complete. 2024-04-01T15:21:54.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.322+0000 7f0565c00640 1 Processor -- start 2024-04-01T15:21:54.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.322+0000 7f0565c00640 1 -- start start 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.323+0000 7f0565c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05600aee60 0x7f0560072070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.323+0000 7f0565c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05600b5970 0x7f056013a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.323+0000 7f0565c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5d50 0x7f05601e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.323+0000 7f0565c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0560148080 con 0x7f05600b5d50 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.323+0000 7f0565c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0560147f00 con 0x7f05600b5970 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.323+0000 7f0565c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f05600b2340 con 0x7f05600aee60 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.323+0000 7f0565200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5d50 0x7f05601e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.323+0000 7f0565200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5d50 0x7f05601e05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51384/0 (socket says 172.21.15.142:51384) 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.323+0000 7f0565200640 1 -- 172.21.15.142:0/3965429574 learned_addr learned my addr 172.21.15.142:0/3965429574 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0565200640 1 -- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05600aee60 msgr2=0x7f0560072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f055fe00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05600aee60 0x7f0560072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0565200640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05600aee60 0x7f0560072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0565200640 1 -- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05600b5970 msgr2=0x7f056013a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f055f400640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05600b5970 0x7f056013a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0565200640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05600b5970 0x7f056013a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0565200640 1 -- 172.21.15.142:0/3965429574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05600b27d0 con 0x7f05600b5d50 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f055f400640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05600b5970 0x7f056013a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0565200640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5d50 0x7f05601e05a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f055800c780 tx=0x7f055800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0557e00640 1 -- 172.21.15.142:0/3965429574 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558018070 con 0x7f05600b5d50 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0557e00640 1 -- 172.21.15.142:0/3965429574 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055800a640 con 0x7f05600b5d50 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0557e00640 1 -- 172.21.15.142:0/3965429574 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055800aab0 con 0x7f05600b5d50 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056013a6e0 con 0x7f05600b5d50 2024-04-01T15:21:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.324+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0560140f20 con 0x7f05600b5d50 2024-04-01T15:21:54.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.326+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05600af7b0 con 0x7f05600b5d50 2024-04-01T15:21:54.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.326+0000 7f0557e00640 1 -- 172.21.15.142:0/3965429574 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f055801b070 con 0x7f05600b5d50 2024-04-01T15:21:54.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.327+0000 7f0557e00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f054006c920 0x7f054006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.327+0000 7f0557e00640 1 -- 172.21.15.142:0/3965429574 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f055808ada0 con 0x7f05600b5d50 2024-04-01T15:21:54.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.328+0000 7f055fe00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f054006c920 0x7f054006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.329+0000 7f055fe00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f054006c920 0x7f054006ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0550036000 tx=0x7f0550008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:54.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.331+0000 7f0557e00640 1 -- 172.21.15.142:0/3965429574 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f05600af7b0 con 0x7f05600b5d50 2024-04-01T15:21:54.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.537+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05600b65b0 con 0x7f05600b5d50 2024-04-01T15:21:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.539+0000 7f0557e00640 1 -- 172.21.15.142:0/3965429574 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7f05600b65b0 con 0x7f05600b5d50 2024-04-01T15:21:54.541 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:21:54.541 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":16,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:48.870146+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:21:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f054006c920 msgr2=0x7f054006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f054006c920 0x7f054006ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0550036000 tx=0x7f0550008030 comp rx=0 tx=0).stop 2024-04-01T15:21:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5d50 msgr2=0x7f05601e05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5d50 0x7f05601e05a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f055800c780 tx=0x7f055800cc40 comp rx=0 tx=0).stop 2024-04-01T15:21:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 shutdown_connections 2024-04-01T15:21:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f054006c920 0x7f054006ede0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05600b5d50 0x7f05601e05a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05600b5970 0x7f056013a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 --2- 172.21.15.142:0/3965429574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05600aee60 0x7f0560072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 >> 172.21.15.142:0/3965429574 conn(0x7f056006c710 msgr2=0x7f056006caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 shutdown_connections 2024-04-01T15:21:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.542+0000 7f0565c00640 1 -- 172.21.15.142:0/3965429574 wait complete. 2024-04-01T15:21:54.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T15:21:46.589606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T15:21:54.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T15:21:54.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.771+0000 7f6e03200640 1 Processor -- start 2024-04-01T15:21:54.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.771+0000 7f6e03200640 1 -- start start 2024-04-01T15:21:54.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.772+0000 7f6e03200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6dfc0afae0 0x7f6dfc0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.772+0000 7f6e03200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc0b55a0 con 0x7f6dfc14ae90 2024-04-01T15:21:54.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.772+0000 7f6e03200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc0b0430 con 0x7f6dfc0b51c0 2024-04-01T15:21:54.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.772+0000 7f6e03200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6dfc0ae8c0 con 0x7f6dfc0afae0 2024-04-01T15:21:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.773+0000 7f6e01200640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6dfc14ae90 0x7f6dfc1521c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54042/0 (socket says 172.21.15.142:54042) 2024-04-01T15:21:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.773+0000 7f6e01200640 1 -- 172.21.15.142:0/2936114765 learned_addr learned my addr 172.21.15.142:0/2936114765 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.773+0000 7f6dfb400640 1 --2- 172.21.15.142:0/2936114765 >> v2:172.21.15.142:3300/0 conn(0x7f6dfc0afae0 0x7f6dfc0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.773+0000 7f6dfaa00640 1 -- 172.21.15.142:0/2936114765 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524769981 0 0) 0x7f6dfc0b55a0 con 0x7f6dfc14ae90 2024-04-01T15:21:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.773+0000 7f6dfb400640 1 -- 172.21.15.142:0/2936114765 >> v1:172.21.15.179:6789/0 conn(0x7f6dfc0b51c0 legacy=0x7f6dfc0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.773+0000 7f6dfb400640 1 -- 172.21.15.142:0/2936114765 >> v1:172.21.15.142:6789/0 conn(0x7f6dfc14ae90 legacy=0x7f6dfc1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.773+0000 7f6dfb400640 1 -- 172.21.15.142:0/2936114765 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc06db20 con 0x7f6dfc0afae0 2024-04-01T15:21:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.774+0000 7f6dfb400640 1 --2- 172.21.15.142:0/2936114765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc0afae0 0x7f6dfc0b22a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6de80097d0 tx=0x7f6de802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ddecdd585f9dd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:54.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6dfaa00640 1 -- 172.21.15.142:0/2936114765 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de80315a0 con 0x7f6dfc0afae0 2024-04-01T15:21:54.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6dfaa00640 1 -- 172.21.15.142:0/2936114765 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de8037070 con 0x7f6dfc0afae0 2024-04-01T15:21:54.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6dfaa00640 1 -- 172.21.15.142:0/2936114765 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8031960 con 0x7f6dfc0afae0 2024-04-01T15:21:54.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6e03200640 1 -- 172.21.15.142:0/2936114765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc0afae0 msgr2=0x7f6dfc0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6e03200640 1 --2- 172.21.15.142:0/2936114765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc0afae0 0x7f6dfc0b22a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6de80097d0 tx=0x7f6de802b840 comp rx=0 tx=0).stop 2024-04-01T15:21:54.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6e03200640 1 -- 172.21.15.142:0/2936114765 shutdown_connections 2024-04-01T15:21:54.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6e03200640 1 --2- 172.21.15.142:0/2936114765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc0afae0 0x7f6dfc0b22a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6e03200640 1 -- 172.21.15.142:0/2936114765 >> 172.21.15.142:0/2936114765 conn(0x7f6dfc0b5890 msgr2=0x7f6dfc0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:54.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6e03200640 1 -- 172.21.15.142:0/2936114765 shutdown_connections 2024-04-01T15:21:54.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.775+0000 7f6e03200640 1 -- 172.21.15.142:0/2936114765 wait complete. 2024-04-01T15:21:54.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.777+0000 7f6e03200640 1 Processor -- start 2024-04-01T15:21:54.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.777+0000 7f6e03200640 1 -- start start 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6e03200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dfc0b51c0 0x7f6dfc06ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6e03200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc14ae90 0x7f6dfc1410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6e03200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dfc141600 0x7f6dfc071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6e03200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc0ae2f0 con 0x7f6dfc14ae90 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6e03200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc0ae170 con 0x7f6dfc0b51c0 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6e03200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6dfc0aede0 con 0x7f6dfc141600 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6dfb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc14ae90 0x7f6dfc1410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6dfb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc14ae90 0x7f6dfc1410c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51394/0 (socket says 172.21.15.142:51394) 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6dfb400640 1 -- 172.21.15.142:0/1498429749 learned_addr learned my addr 172.21.15.142:0/1498429749 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6dfbe00640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dfc0b51c0 0x7f6dfc06ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6dfb400640 1 -- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dfc141600 msgr2=0x7f6dfc071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.778+0000 7f6e01200640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dfc141600 0x7f6dfc071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6dfb400640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dfc141600 0x7f6dfc071c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6dfb400640 1 -- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dfc0b51c0 msgr2=0x7f6dfc06ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6dfb400640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dfc0b51c0 0x7f6dfc06ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6dfb400640 1 -- 172.21.15.142:0/1498429749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc070e90 con 0x7f6dfc14ae90 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6dfbe00640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dfc0b51c0 0x7f6dfc06ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6dfb400640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc14ae90 0x7f6dfc1410c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6de8034040 tx=0x7f6de80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6df3e00640 1 -- 172.21.15.142:0/1498429749 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8032840 con 0x7f6dfc14ae90 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dfc0706b0 con 0x7f6dfc14ae90 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6df3e00640 1 -- 172.21.15.142:0/1498429749 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de80329e0 con 0x7f6dfc14ae90 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6df3e00640 1 -- 172.21.15.142:0/1498429749 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8032dd0 con 0x7f6dfc14ae90 2024-04-01T15:21:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.779+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dfc072370 con 0x7f6dfc14ae90 2024-04-01T15:21:54.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.780+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dfc02d540 con 0x7f6dfc14ae90 2024-04-01T15:21:54.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.781+0000 7f6df3e00640 1 -- 172.21.15.142:0/1498429749 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6de803b3f0 con 0x7f6dfc14ae90 2024-04-01T15:21:54.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.783+0000 7f6df3e00640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6ddc06c8f0 0x7f6ddc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:54.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.783+0000 7f6df3e00640 1 -- 172.21.15.142:0/1498429749 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6de802f030 con 0x7f6dfc14ae90 2024-04-01T15:21:54.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.783+0000 7f6dfbe00640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6ddc06c8f0 0x7f6ddc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:54.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.784+0000 7f6dfbe00640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6ddc06c8f0 0x7f6ddc06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc144e30 tx=0x7f6dec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:54.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.787+0000 7f6df3e00640 1 -- 172.21.15.142:0/1498429749 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6dfc02d540 con 0x7f6dfc14ae90 2024-04-01T15:21:54.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.987+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6dfc141a10 con 0x7f6dfc14ae90 2024-04-01T15:21:54.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.988+0000 7f6df3e00640 1 -- 172.21.15.142:0/1498429749 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f6dfc141a10 con 0x7f6dfc14ae90 2024-04-01T15:21:54.990 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6ddc06c8f0 msgr2=0x7f6ddc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6ddc06c8f0 0x7f6ddc06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc144e30 tx=0x7f6dec009040 comp rx=0 tx=0).stop 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc14ae90 msgr2=0x7f6dfc1410c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc14ae90 0x7f6dfc1410c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6de8034040 tx=0x7f6de80046c0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 shutdown_connections 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6ddc06c8f0 0x7f6ddc06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dfc141600 0x7f6dfc071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc14ae90 0x7f6dfc1410c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 --2- 172.21.15.142:0/1498429749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dfc0b51c0 0x7f6dfc06ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 >> 172.21.15.142:0/1498429749 conn(0x7f6dfc0b5890 msgr2=0x7f6dfc1483d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 shutdown_connections 2024-04-01T15:21:54.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:54.991+0000 7f6e03200640 1 -- 172.21.15.142:0/1498429749 wait complete. 2024-04-01T15:21:55.011 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-01T15:21:55.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.217+0000 7f683a800640 1 Processor -- start 2024-04-01T15:21:55.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.218+0000 7f683a800640 1 -- start start 2024-04-01T15:21:55.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.219+0000 7f683a800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f683406d8d0 0x7f68340ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.219+0000 7f683a800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68340b0290 0x7f68340aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.219+0000 7f683a800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6834147be0 0x7f6834148050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.219+0000 7f683a800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f68340b1790 con 0x7f683406d8d0 2024-04-01T15:21:55.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.219+0000 7f683a800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f683406dcb0 con 0x7f68340b0290 2024-04-01T15:21:55.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.219+0000 7f683a800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f68340b14b0 con 0x7f6834147be0 2024-04-01T15:21:55.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.219+0000 7f6833400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f683406d8d0 0x7f68340ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.219+0000 7f6833400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f683406d8d0 0x7f68340ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59724/0 (socket says 172.21.15.142:59724) 2024-04-01T15:21:55.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.219+0000 7f6833400640 1 -- 172.21.15.142:0/2250930474 learned_addr learned my addr 172.21.15.142:0/2250930474 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:55.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.220+0000 7f6833e00640 1 --2- 172.21.15.142:0/2250930474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6834147be0 0x7f6834148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.220+0000 7f6832a00640 1 --2- 172.21.15.142:0/2250930474 >> v2:172.21.15.179:3300/0 conn(0x7f68340b0290 0x7f68340aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.220+0000 7f6833400640 1 -- 172.21.15.142:0/2250930474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6834147be0 msgr2=0x7f6834148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:55.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.220+0000 7f6833400640 1 --2- 172.21.15.142:0/2250930474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6834147be0 0x7f6834148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.220+0000 7f6833400640 1 -- 172.21.15.142:0/2250930474 >> v2:172.21.15.179:3300/0 conn(0x7f68340b0290 msgr2=0x7f68340aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:55.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.220+0000 7f6833400640 1 --2- 172.21.15.142:0/2250930474 >> v2:172.21.15.179:3300/0 conn(0x7f68340b0290 0x7f68340aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.220+0000 7f6833400640 1 -- 172.21.15.142:0/2250930474 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68340b53b0 con 0x7f683406d8d0 2024-04-01T15:21:55.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.220+0000 7f6833e00640 1 --2- 172.21.15.142:0/2250930474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6834147be0 0x7f6834148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:55.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.220+0000 7f6832a00640 1 --2- 172.21.15.142:0/2250930474 >> v2:172.21.15.179:3300/0 conn(0x7f68340b0290 0x7f68340aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:55.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.221+0000 7f6833400640 1 --2- 172.21.15.142:0/2250930474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f683406d8d0 0x7f68340ae890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68340b67e0 tx=0x7f682402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2022e381a481ac32 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:55.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.221+0000 7f6832000640 1 -- 172.21.15.142:0/2250930474 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824035020 con 0x7f683406d8d0 2024-04-01T15:21:55.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.221+0000 7f6832000640 1 -- 172.21.15.142:0/2250930474 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6824031640 con 0x7f683406d8d0 2024-04-01T15:21:55.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.221+0000 7f6832000640 1 -- 172.21.15.142:0/2250930474 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682402d040 con 0x7f683406d8d0 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.222+0000 7f683a800640 1 -- 172.21.15.142:0/2250930474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f683406d8d0 msgr2=0x7f68340ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.222+0000 7f683a800640 1 --2- 172.21.15.142:0/2250930474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f683406d8d0 0x7f68340ae890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68340b67e0 tx=0x7f682402b8f0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.222+0000 7f683a800640 1 -- 172.21.15.142:0/2250930474 shutdown_connections 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.222+0000 7f683a800640 1 --2- 172.21.15.142:0/2250930474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6834147be0 0x7f6834148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.222+0000 7f683a800640 1 --2- 172.21.15.142:0/2250930474 >> v2:172.21.15.179:3300/0 conn(0x7f68340b0290 0x7f68340aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.222+0000 7f683a800640 1 --2- 172.21.15.142:0/2250930474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f683406d8d0 0x7f68340ae890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.222+0000 7f683a800640 1 -- 172.21.15.142:0/2250930474 >> 172.21.15.142:0/2250930474 conn(0x7f68340b5890 msgr2=0x7f68340b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.222+0000 7f683a800640 1 -- 172.21.15.142:0/2250930474 shutdown_connections 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.222+0000 7f683a800640 1 -- 172.21.15.142:0/2250930474 wait complete. 2024-04-01T15:21:55.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.223+0000 7f683a800640 1 Processor -- start 2024-04-01T15:21:55.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.223+0000 7f683a800640 1 -- start start 2024-04-01T15:21:55.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.224+0000 7f683a800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683406d8d0 0x7f683409d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.224+0000 7f683a800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340b0290 0x7f68341448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.224+0000 7f683a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6834147be0 0x7f6834144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.224+0000 7f683a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f68340ae370 con 0x7f6834147be0 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.224+0000 7f683a800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f68340ae090 con 0x7f68340b0290 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.224+0000 7f683a800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6834148590 con 0x7f683406d8d0 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.224+0000 7f6833e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6834147be0 0x7f6834144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6833e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6834147be0 0x7f6834144e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59736/0 (socket says 172.21.15.142:59736) 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6833e00640 1 -- 172.21.15.142:0/1096234434 learned_addr learned my addr 172.21.15.142:0/1096234434 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6833400640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683406d8d0 0x7f683409d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6832a00640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340b0290 0x7f68341448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6833e00640 1 -- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683406d8d0 msgr2=0x7f683409d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6833e00640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683406d8d0 0x7f683409d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6833e00640 1 -- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340b0290 msgr2=0x7f68341448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6833e00640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340b0290 0x7f68341448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6833e00640 1 -- 172.21.15.142:0/1096234434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6834147010 con 0x7f6834147be0 2024-04-01T15:21:55.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f6833e00640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6834147be0 0x7f6834144e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c7c0 tx=0x7f682c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:55.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f682b400640 1 -- 172.21.15.142:0/1096234434 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c015020 con 0x7f6834147be0 2024-04-01T15:21:55.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f682b400640 1 -- 172.21.15.142:0/1096234434 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c004230 con 0x7f6834147be0 2024-04-01T15:21:55.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f682b400640 1 -- 172.21.15.142:0/1096234434 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c007620 con 0x7f6834147be0 2024-04-01T15:21:55.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.225+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683409e3e0 con 0x7f6834147be0 2024-04-01T15:21:55.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.226+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6834146070 con 0x7f6834147be0 2024-04-01T15:21:55.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.227+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6834068710 con 0x7f6834147be0 2024-04-01T15:21:55.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.228+0000 7f682b400640 1 -- 172.21.15.142:0/1096234434 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f682c018020 con 0x7f6834147be0 2024-04-01T15:21:55.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.229+0000 7f682b400640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f681006c8f0 0x7f681006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.229+0000 7f682b400640 1 -- 172.21.15.142:0/1096234434 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f682c08b860 con 0x7f6834147be0 2024-04-01T15:21:55.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.229+0000 7f6833400640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f681006c8f0 0x7f681006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.230+0000 7f6833400640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f681006c8f0 0x7f681006edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6824036000 tx=0x7f682403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:55.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.233+0000 7f682b400640 1 -- 172.21.15.142:0/1096234434 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f682c01f020 con 0x7f6834147be0 2024-04-01T15:21:55.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.433+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f68340b7710 con 0x7f6834147be0 2024-04-01T15:21:55.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.434+0000 7f682b400640 1 -- 172.21.15.142:0/1096234434 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f682c05a000 con 0x7f6834147be0 2024-04-01T15:21:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:21:55.436 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2024-04-01T15:21:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-01T15:21:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2024-04-01T15:21:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2024-04-01T15:21:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-01T15:21:55.436 INFO:teuthology.orchestra.run.smithi142.stdout:] 2024-04-01T15:21:55.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.437+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f681006c8f0 msgr2=0x7f681006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:55.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.437+0000 7f683a800640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f681006c8f0 0x7f681006edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6824036000 tx=0x7f682403c040 comp rx=0 tx=0).stop 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.437+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6834147be0 msgr2=0x7f6834144e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.437+0000 7f683a800640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6834147be0 0x7f6834144e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c7c0 tx=0x7f682c00cc80 comp rx=0 tx=0).stop 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.438+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 shutdown_connections 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.438+0000 7f683a800640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f681006c8f0 0x7f681006edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.438+0000 7f683a800640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6834147be0 0x7f6834144e30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.438+0000 7f683a800640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340b0290 0x7f68341448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.438+0000 7f683a800640 1 --2- 172.21.15.142:0/1096234434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683406d8d0 0x7f683409d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.438+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 >> 172.21.15.142:0/1096234434 conn(0x7f68340b5890 msgr2=0x7f68340b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.438+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 shutdown_connections 2024-04-01T15:21:55.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.438+0000 7f683a800640 1 -- 172.21.15.142:0/1096234434 wait complete. 2024-04-01T15:21:55.458 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-01T15:21:55.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-01T15:21:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.665+0000 7fcbbb000640 1 Processor -- start 2024-04-01T15:21:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.665+0000 7fcbbb000640 1 -- start start 2024-04-01T15:21:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.666+0000 7fcbbb000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb406edd0 0x7fcbb406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.666+0000 7fcbbb000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcbb40732a0 0x7fcbb41447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.666+0000 7fcbbb000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb406f1b0 con 0x7fcbb40b5990 2024-04-01T15:21:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.666+0000 7fcbbb000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb40b6af0 con 0x7fcbb40732a0 2024-04-01T15:21:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.666+0000 7fcbbb000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb40b71a0 con 0x7fcbb406edd0 2024-04-01T15:21:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb3400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcbb40732a0 0x7fcbb41447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb9000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcbb40b5990 0x7fcbb4144d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54428/0 (socket says 172.21.15.142:54428) 2024-04-01T15:21:55.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb9000640 1 -- 172.21.15.142:0/2308015717 learned_addr learned my addr 172.21.15.142:0/2308015717 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:55.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb2a00640 1 -- 172.21.15.142:0/2308015717 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940836574 0 0) 0x7fcbb406f1b0 con 0x7fcbb40b5990 2024-04-01T15:21:55.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb2a00640 1 -- 172.21.15.142:0/2308015717 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb98003520 con 0x7fcbb40b5990 2024-04-01T15:21:55.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb3e00640 1 --2- 172.21.15.142:0/2308015717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb406edd0 0x7fcbb406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb3400640 1 -- 172.21.15.142:0/2308015717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb406edd0 msgr2=0x7fcbb406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb3400640 1 --2- 172.21.15.142:0/2308015717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb406edd0 0x7fcbb406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb3400640 1 -- 172.21.15.142:0/2308015717 >> v1:172.21.15.142:6789/0 conn(0x7fcbb40b5990 legacy=0x7fcbb4144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.667+0000 7fcbb3400640 1 -- 172.21.15.142:0/2308015717 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb40b7480 con 0x7fcbb40732a0 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbb3400640 1 --2- 172.21.15.142:0/2308015717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb40732a0 0x7fcbb41447d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097a0 tx=0x7fcba002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b69d6683585fdc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbb2a00640 1 -- 172.21.15.142:0/2308015717 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0035020 con 0x7fcbb40732a0 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbb2a00640 1 -- 172.21.15.142:0/2308015717 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba0031810 con 0x7fcbb40732a0 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbb2a00640 1 -- 172.21.15.142:0/2308015717 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0031be0 con 0x7fcbb40732a0 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbbb000640 1 -- 172.21.15.142:0/2308015717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb40732a0 msgr2=0x7fcbb41447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbbb000640 1 --2- 172.21.15.142:0/2308015717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb40732a0 0x7fcbb41447d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097a0 tx=0x7fcba002b8b0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbbb000640 1 -- 172.21.15.142:0/2308015717 shutdown_connections 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbbb000640 1 --2- 172.21.15.142:0/2308015717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb40732a0 0x7fcbb41447d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbbb000640 1 --2- 172.21.15.142:0/2308015717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb406edd0 0x7fcbb406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.669+0000 7fcbbb000640 1 -- 172.21.15.142:0/2308015717 >> 172.21.15.142:0/2308015717 conn(0x7fcbb40bb380 msgr2=0x7fcbb40bb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.670+0000 7fcbbb000640 1 -- 172.21.15.142:0/2308015717 shutdown_connections 2024-04-01T15:21:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.670+0000 7fcbbb000640 1 -- 172.21.15.142:0/2308015717 wait complete. 2024-04-01T15:21:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.671+0000 7fcbbb000640 1 Processor -- start 2024-04-01T15:21:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.671+0000 7fcbbb000640 1 -- start start 2024-04-01T15:21:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.672+0000 7fcbbb000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb406edd0 0x7fcbb40b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.672+0000 7fcbbb000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb40732a0 0x7fcbb40b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.672+0000 7fcbbb000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb40b5990 0x7fcbb4142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.672+0000 7fcbbb000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb40b6f40 con 0x7fcbb406edd0 2024-04-01T15:21:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.672+0000 7fcbbb000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb40b6dc0 con 0x7fcbb40732a0 2024-04-01T15:21:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.672+0000 7fcbbb000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb406daf0 con 0x7fcbb40b5990 2024-04-01T15:21:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.672+0000 7fcbb3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb406edd0 0x7fcbb40b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.672+0000 7fcbb3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb406edd0 0x7fcbb40b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59740/0 (socket says 172.21.15.142:59740) 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.672+0000 7fcbb3e00640 1 -- 172.21.15.142:0/1973392329 learned_addr learned my addr 172.21.15.142:0/1973392329 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb3400640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb40732a0 0x7fcbb40b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb9000640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb40b5990 0x7fcbb4142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb3e00640 1 -- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb40b5990 msgr2=0x7fcbb4142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb3e00640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb40b5990 0x7fcbb4142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb3e00640 1 -- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb40732a0 msgr2=0x7fcbb40b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb3e00640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb40732a0 0x7fcbb40b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb3e00640 1 -- 172.21.15.142:0/1973392329 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb40b4f00 con 0x7fcbb406edd0 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb3400640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb40732a0 0x7fcbb40b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb9000640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb40b5990 0x7fcbb4142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbb3e00640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb406edd0 0x7fcbb40b28a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcba400d830 tx=0x7fcba400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbabe00640 1 -- 172.21.15.142:0/1973392329 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba400b6c0 con 0x7fcbb406edd0 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbabe00640 1 -- 172.21.15.142:0/1973392329 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba4019070 con 0x7fcbb406edd0 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb40b3c20 con 0x7fcbb406edd0 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.673+0000 7fcbabe00640 1 -- 172.21.15.142:0/1973392329 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba400ba80 con 0x7fcbb406edd0 2024-04-01T15:21:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.674+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb40b4700 con 0x7fcbb406edd0 2024-04-01T15:21:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.675+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb4068710 con 0x7fcbb406edd0 2024-04-01T15:21:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.675+0000 7fcbabe00640 1 -- 172.21.15.142:0/1973392329 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcba401e460 con 0x7fcbb406edd0 2024-04-01T15:21:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.676+0000 7fcbabe00640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb9406c8f0 0x7fcb9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:55.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.676+0000 7fcbabe00640 1 -- 172.21.15.142:0/1973392329 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fcba408bef0 con 0x7fcbb406edd0 2024-04-01T15:21:55.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.677+0000 7fcbb3400640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb9406c8f0 0x7fcb9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:55.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.678+0000 7fcbb3400640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb9406c8f0 0x7fcb9406edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcba0036000 tx=0x7fcba0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:55.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.681+0000 7fcbabe00640 1 -- 172.21.15.142:0/1973392329 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcba405a660 con 0x7fcbb406edd0 2024-04-01T15:21:55.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:55.874+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcbb406d7c0 con 0x7fcbb406edd0 2024-04-01T15:21:56.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.470+0000 7fcbabe00640 1 -- 172.21.15.142:0/1973392329 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fcba4059f60 con 0x7fcbb406edd0 2024-04-01T15:21:56.472 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2024-04-01T15:21:56.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb9406c8f0 msgr2=0x7fcb9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:56.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb9406c8f0 0x7fcb9406edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcba0036000 tx=0x7fcba0008030 comp rx=0 tx=0).stop 2024-04-01T15:21:56.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb406edd0 msgr2=0x7fcbb40b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:56.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb406edd0 0x7fcbb40b28a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcba400d830 tx=0x7fcba400dcf0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 shutdown_connections 2024-04-01T15:21:56.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb9406c8f0 0x7fcb9406edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb40b5990 0x7fcbb4142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb40732a0 0x7fcbb40b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 --2- 172.21.15.142:0/1973392329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb406edd0 0x7fcbb40b28a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 >> 172.21.15.142:0/1973392329 conn(0x7fcbb40bb380 msgr2=0x7fcbb40b8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:56.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 shutdown_connections 2024-04-01T15:21:56.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.474+0000 7fcbbb000640 1 -- 172.21.15.142:0/1973392329 wait complete. 2024-04-01T15:21:56.500 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-01T15:21:56.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.697+0000 7f3473400640 1 Processor -- start 2024-04-01T15:21:56.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.697+0000 7f3473400640 1 -- start start 2024-04-01T15:21:56.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.698+0000 7f3473400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 0x7f346c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:56.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.698+0000 7f3473400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f346c14f870 0x7f346c14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:56.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.698+0000 7f3473400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f346c0b56b0 con 0x7f346c06d8d0 2024-04-01T15:21:56.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.698+0000 7f3473400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f346c0ae660 con 0x7f346c14f870 2024-04-01T15:21:56.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.698+0000 7f3473400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f346c0b03c0 con 0x7f346c0af200 2024-04-01T15:21:56.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.698+0000 7f3470a00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f346c06d8d0 0x7f346c0aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54440/0 (socket says 172.21.15.142:54440) 2024-04-01T15:21:56.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.698+0000 7f3470a00640 1 -- 172.21.15.142:0/3538688504 learned_addr learned my addr 172.21.15.142:0/3538688504 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:56.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.698+0000 7f3471400640 1 --2- 172.21.15.142:0/3538688504 >> v2:172.21.15.142:3300/0 conn(0x7f346c14f870 0x7f346c14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:56.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.699+0000 7f3463e00640 1 --2- 172.21.15.142:0/3538688504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 0x7f346c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:56.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.699+0000 7f346be00640 1 -- 172.21.15.142:0/3538688504 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558818316 0 0) 0x7f345c001110 con 0x7f346c06d8d0 2024-04-01T15:21:56.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.699+0000 7f346be00640 1 -- 172.21.15.142:0/3538688504 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3450003520 con 0x7f346c06d8d0 2024-04-01T15:21:56.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.699+0000 7f346be00640 1 -- 172.21.15.142:0/3538688504 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2311803842 0 0) 0x7f3450003520 con 0x7f346c06d8d0 2024-04-01T15:21:56.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.699+0000 7f3471400640 1 -- 172.21.15.142:0/3538688504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 msgr2=0x7f346c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:56.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.699+0000 7f3471400640 1 --2- 172.21.15.142:0/3538688504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 0x7f346c14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.699+0000 7f3471400640 1 -- 172.21.15.142:0/3538688504 >> v1:172.21.15.142:6789/0 conn(0x7f346c06d8d0 legacy=0x7f346c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:56.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.699+0000 7f3471400640 1 -- 172.21.15.142:0/3538688504 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c06dcb0 con 0x7f346c14f870 2024-04-01T15:21:56.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.700+0000 7f3471400640 1 --2- 172.21.15.142:0/3538688504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 0x7f346c14fd00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3464009dc0 tx=0x7f346402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521d9cb463c10481 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:56.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.701+0000 7f346be00640 1 -- 172.21.15.142:0/3538688504 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464039070 con 0x7f346c14f870 2024-04-01T15:21:56.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.701+0000 7f346be00640 1 -- 172.21.15.142:0/3538688504 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346402c760 con 0x7f346c14f870 2024-04-01T15:21:56.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.701+0000 7f346be00640 1 -- 172.21.15.142:0/3538688504 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c001840 con 0x7f346c14f870 2024-04-01T15:21:56.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.701+0000 7f3473400640 1 -- 172.21.15.142:0/3538688504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 msgr2=0x7f346c14fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:56.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.701+0000 7f3473400640 1 --2- 172.21.15.142:0/3538688504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 0x7f346c14fd00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3464009dc0 tx=0x7f346402bc30 comp rx=0 tx=0).stop 2024-04-01T15:21:56.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.701+0000 7f3473400640 1 -- 172.21.15.142:0/3538688504 shutdown_connections 2024-04-01T15:21:56.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.701+0000 7f3473400640 1 --2- 172.21.15.142:0/3538688504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 0x7f346c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.701+0000 7f3473400640 1 --2- 172.21.15.142:0/3538688504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 0x7f346c14fd00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.701+0000 7f3473400640 1 -- 172.21.15.142:0/3538688504 >> 172.21.15.142:0/3538688504 conn(0x7f346c0b5890 msgr2=0x7f346c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:56.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.702+0000 7f3473400640 1 -- 172.21.15.142:0/3538688504 shutdown_connections 2024-04-01T15:21:56.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.702+0000 7f3473400640 1 -- 172.21.15.142:0/3538688504 wait complete. 2024-04-01T15:21:56.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.703+0000 7f3473400640 1 Processor -- start 2024-04-01T15:21:56.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.703+0000 7f3473400640 1 -- start start 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3473400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c06d8d0 0x7f346c148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3473400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 0x7f346c1e19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3473400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 0x7f346c1e1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3473400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f346c0afd70 con 0x7f346c14f870 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3473400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f346c0b53d0 con 0x7f346c06d8d0 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3473400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f346c0b3210 con 0x7f346c0af200 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3471400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 0x7f346c1e1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3471400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 0x7f346c1e1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59762/0 (socket says 172.21.15.142:59762) 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3471400640 1 -- 172.21.15.142:0/22783854 learned_addr learned my addr 172.21.15.142:0/22783854 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.704+0000 7f3463e00640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 0x7f346c1e19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:56.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3470a00640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c06d8d0 0x7f346c148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3471400640 1 -- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 msgr2=0x7f346c1e19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3471400640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 0x7f346c1e19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3471400640 1 -- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c06d8d0 msgr2=0x7f346c148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3471400640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c06d8d0 0x7f346c148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3471400640 1 -- 172.21.15.142:0/22783854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c1497a0 con 0x7f346c14f870 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3470a00640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c06d8d0 0x7f346c148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3471400640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 0x7f346c1e1f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3464009ee0 tx=0x7f3464004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3469600640 1 -- 172.21.15.142:0/22783854 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464039050 con 0x7f346c14f870 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3469600640 1 -- 172.21.15.142:0/22783854 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3464045070 con 0x7f346c14f870 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3469600640 1 -- 172.21.15.142:0/22783854 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464034e20 con 0x7f346c14f870 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346c1472a0 con 0x7f346c14f870 2024-04-01T15:21:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.705+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346c147860 con 0x7f346c14f870 2024-04-01T15:21:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.706+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346c1470b0 con 0x7f346c14f870 2024-04-01T15:21:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.707+0000 7f3469600640 1 -- 172.21.15.142:0/22783854 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f346404a460 con 0x7f346c14f870 2024-04-01T15:21:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.708+0000 7f3469600640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f344806c8f0 0x7f344806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:56.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.708+0000 7f3469600640 1 -- 172.21.15.142:0/22783854 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f34640ae0f0 con 0x7f346c14f870 2024-04-01T15:21:56.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.709+0000 7f3470a00640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f344806c8f0 0x7f344806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:56.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.710+0000 7f3470a00640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f344806c8f0 0x7f344806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f345c0019b0 tx=0x7f345c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:56.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.713+0000 7f3469600640 1 -- 172.21.15.142:0/22783854 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f346407c6f0 con 0x7f346c14f870 2024-04-01T15:21:56.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:56.913+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f346c0b8ba0 con 0x7f346c14f870 2024-04-01T15:21:57.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.485+0000 7f3469600640 1 -- 172.21.15.142:0/22783854 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f346407bff0 con 0x7f346c14f870 2024-04-01T15:21:57.487 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f344806c8f0 msgr2=0x7f344806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f344806c8f0 0x7f344806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f345c0019b0 tx=0x7f345c009040 comp rx=0 tx=0).stop 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 msgr2=0x7f346c1e1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 0x7f346c1e1f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3464009ee0 tx=0x7f3464004a40 comp rx=0 tx=0).stop 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 shutdown_connections 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f344806c8f0 0x7f344806edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f346c14f870 0x7f346c1e1f20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346c0af200 0x7f346c1e19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 --2- 172.21.15.142:0/22783854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c06d8d0 0x7f346c148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 >> 172.21.15.142:0/22783854 conn(0x7f346c0b5890 msgr2=0x7f346c06cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:57.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.489+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 shutdown_connections 2024-04-01T15:21:57.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.490+0000 7f3473400640 1 -- 172.21.15.142:0/22783854 wait complete. 2024-04-01T15:21:57.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-01T15:21:57.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.703+0000 7f44a1000640 1 Processor -- start 2024-04-01T15:21:57.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.704+0000 7f44a1000640 1 -- start start 2024-04-01T15:21:57.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.705+0000 7f44a1000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:57.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.705+0000 7f44a1000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f449c0afae0 0x7f449c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:57.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.705+0000 7f44a1000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f449c0b1b90 0x7f449c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.705+0000 7f44a1000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f449c0b55a0 con 0x7f449c0afae0 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.705+0000 7f44a1000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f449c0b0430 con 0x7f449c0b1b90 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.705+0000 7f44a1000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f449c0ae8c0 con 0x7f449c0b51c0 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.705+0000 7f4491400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f449c0afae0 0x7f449c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.705+0000 7f4491400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f449c0afae0 0x7f449c0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59778/0 (socket says 172.21.15.142:59778) 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.705+0000 7f4491400640 1 -- 172.21.15.142:0/2402042243 learned_addr learned my addr 172.21.15.142:0/2402042243 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.706+0000 7f449a800640 1 --2- 172.21.15.142:0/2402042243 >> v2:172.21.15.179:3300/0 conn(0x7f449c0b1b90 0x7f449c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.706+0000 7f4499e00640 1 --2- 172.21.15.142:0/2402042243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.706+0000 7f4491400640 1 -- 172.21.15.142:0/2402042243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 msgr2=0x7f449c14ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.706+0000 7f4491400640 1 --2- 172.21.15.142:0/2402042243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c14ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.706+0000 7f4491400640 1 -- 172.21.15.142:0/2402042243 >> v2:172.21.15.179:3300/0 conn(0x7f449c0b1b90 msgr2=0x7f449c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.706+0000 7f4491400640 1 --2- 172.21.15.142:0/2402042243 >> v2:172.21.15.179:3300/0 conn(0x7f449c0b1b90 0x7f449c0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.706+0000 7f4491400640 1 -- 172.21.15.142:0/2402042243 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c06db20 con 0x7f449c0afae0 2024-04-01T15:21:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.706+0000 7f449a800640 1 --2- 172.21.15.142:0/2402042243 >> v2:172.21.15.179:3300/0 conn(0x7f449c0b1b90 0x7f449c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:57.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.706+0000 7f4499e00640 1 --2- 172.21.15.142:0/2402042243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c14ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.707+0000 7f4491400640 1 --2- 172.21.15.142:0/2402042243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0afae0 0x7f449c0aede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f449c06be60 tx=0x7f448402b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20471bc9b800ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.707+0000 7f4499400640 1 -- 172.21.15.142:0/2402042243 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484031760 con 0x7f449c0afae0 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.707+0000 7f4499400640 1 -- 172.21.15.142:0/2402042243 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4484037070 con 0x7f449c0afae0 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.707+0000 7f4499400640 1 -- 172.21.15.142:0/2402042243 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484031b20 con 0x7f449c0afae0 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.708+0000 7f44a1000640 1 -- 172.21.15.142:0/2402042243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0afae0 msgr2=0x7f449c0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.708+0000 7f44a1000640 1 --2- 172.21.15.142:0/2402042243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0afae0 0x7f449c0aede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f449c06be60 tx=0x7f448402b800 comp rx=0 tx=0).stop 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.708+0000 7f44a1000640 1 -- 172.21.15.142:0/2402042243 shutdown_connections 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.708+0000 7f44a1000640 1 --2- 172.21.15.142:0/2402042243 >> v2:172.21.15.179:3300/0 conn(0x7f449c0b1b90 0x7f449c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.708+0000 7f44a1000640 1 --2- 172.21.15.142:0/2402042243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0afae0 0x7f449c0aede0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.708+0000 7f44a1000640 1 --2- 172.21.15.142:0/2402042243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c14ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.708+0000 7f44a1000640 1 -- 172.21.15.142:0/2402042243 >> 172.21.15.142:0/2402042243 conn(0x7f449c0b5890 msgr2=0x7f449c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.708+0000 7f44a1000640 1 -- 172.21.15.142:0/2402042243 shutdown_connections 2024-04-01T15:21:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.708+0000 7f44a1000640 1 -- 172.21.15.142:0/2402042243 wait complete. 2024-04-01T15:21:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.710+0000 7f44a1000640 1 Processor -- start 2024-04-01T15:21:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.710+0000 7f44a1000640 1 -- start start 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.710+0000 7f44a1000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449c0b1b90 0x7f449c0723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f44a1000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f44a1000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c071480 0x7f449c143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f44a1000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f449c0adf30 con 0x7f449c071480 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f44a1000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f449c0addb0 con 0x7f449c0b1b90 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f44a1000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f449c0ae170 con 0x7f449c0b51c0 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f449a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c071480 0x7f449c143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f449a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c071480 0x7f449c143610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59794/0 (socket says 172.21.15.142:59794) 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f449a800640 1 -- 172.21.15.142:0/3466071830 learned_addr learned my addr 172.21.15.142:0/3466071830 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f4491400640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f4499e00640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449c0b1b90 0x7f449c0723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f449a800640 1 -- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 msgr2=0x7f449c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f449a800640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f449a800640 1 -- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449c0b1b90 msgr2=0x7f449c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:57.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f449a800640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449c0b1b90 0x7f449c0723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:57.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f449a800640 1 -- 172.21.15.142:0/3466071830 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c070c00 con 0x7f449c071480 2024-04-01T15:21:57.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.711+0000 7f4491400640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:57.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.712+0000 7f449a800640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c071480 0x7f449c143610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f449400cef0 tx=0x7f449400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:57.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.712+0000 7f4492a00640 1 -- 172.21.15.142:0/3466071830 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449401a070 con 0x7f449c071480 2024-04-01T15:21:57.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.712+0000 7f4492a00640 1 -- 172.21.15.142:0/3466071830 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f449400d860 con 0x7f449c071480 2024-04-01T15:21:57.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.712+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c148bb0 con 0x7f449c071480 2024-04-01T15:21:57.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.712+0000 7f4492a00640 1 -- 172.21.15.142:0/3466071830 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449400dc50 con 0x7f449c071480 2024-04-01T15:21:57.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.712+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c0706e0 con 0x7f449c071480 2024-04-01T15:21:57.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.713+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449c0b2300 con 0x7f449c071480 2024-04-01T15:21:57.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.714+0000 7f4492a00640 1 -- 172.21.15.142:0/3466071830 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f449401d070 con 0x7f449c071480 2024-04-01T15:21:57.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.715+0000 7f4492a00640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f447806c8f0 0x7f447806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:57.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.715+0000 7f4492a00640 1 -- 172.21.15.142:0/3466071830 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f449408c3d0 con 0x7f449c071480 2024-04-01T15:21:57.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.716+0000 7f4499e00640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f447806c8f0 0x7f447806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:57.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.718+0000 7f4499e00640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f447806c8f0 0x7f447806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f448c00b7c0 tx=0x7f448c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:57.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.721+0000 7f4492a00640 1 -- 172.21.15.142:0/3466071830 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f449c0b2300 con 0x7f449c071480 2024-04-01T15:21:57.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:57.961+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f449c02d540 con 0x7f449c071480 2024-04-01T15:21:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.490+0000 7f4492a00640 1 -- 172.21.15.142:0/3466071830 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f449c02d540 con 0x7f449c071480 2024-04-01T15:21:58.491 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 2 and data pool 3 2024-04-01T15:21:58.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f447806c8f0 msgr2=0x7f447806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f447806c8f0 0x7f447806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f448c00b7c0 tx=0x7f448c008040 comp rx=0 tx=0).stop 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c071480 msgr2=0x7f449c143610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c071480 0x7f449c143610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f449400cef0 tx=0x7f449400a710 comp rx=0 tx=0).stop 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 shutdown_connections 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f447806c8f0 0x7f447806edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c071480 0x7f449c143610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c0b51c0 0x7f449c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 --2- 172.21.15.142:0/3466071830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449c0b1b90 0x7f449c0723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 >> 172.21.15.142:0/3466071830 conn(0x7f449c0b5890 msgr2=0x7f449c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 shutdown_connections 2024-04-01T15:21:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.495+0000 7f44a1000640 1 -- 172.21.15.142:0/3466071830 wait complete. 2024-04-01T15:21:58.536 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:21:58.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.711+0000 7f05c4600640 1 Processor -- start 2024-04-01T15:21:58.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.711+0000 7f05c4600640 1 -- start start 2024-04-01T15:21:58.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.712+0000 7f05c4600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f05bc06d8d0 0x7f05bc0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:58.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.712+0000 7f05c4600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc06dcb0 con 0x7f05bc0b1410 2024-04-01T15:21:58.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.712+0000 7f05c4600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc148ad0 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.712+0000 7f05c4600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f05bc0b0b20 con 0x7f05bc06d8d0 2024-04-01T15:21:58.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.712+0000 7f05c1c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f05bc06d8d0 0x7f05bc0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:58.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.712+0000 7f05c2600640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f05bc0b1410 0x7f05bc14fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54446/0 (socket says 172.21.15.142:54446) 2024-04-01T15:21:58.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.712+0000 7f05c2600640 1 -- 172.21.15.142:0/4108358258 learned_addr learned my addr 172.21.15.142:0/4108358258 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:21:58.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.713+0000 7f05bbe00640 1 -- 172.21.15.142:0/4108358258 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3771002131 0 0) 0x7f05bc06dcb0 con 0x7f05bc0b1410 2024-04-01T15:21:58.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.713+0000 7f05bbe00640 1 -- 172.21.15.142:0/4108358258 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a4003520 con 0x7f05bc0b1410 2024-04-01T15:21:58.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.713+0000 7f05c1c00640 1 -- 172.21.15.142:0/4108358258 >> v1:172.21.15.179:6789/0 conn(0x7f05bc0b0fb0 legacy=0x7f05bc1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:58.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.713+0000 7f05c1c00640 1 -- 172.21.15.142:0/4108358258 >> v1:172.21.15.142:6789/0 conn(0x7f05bc0b1410 legacy=0x7f05bc14fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:58.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.713+0000 7f05c1c00640 1 -- 172.21.15.142:0/4108358258 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc0b5230 con 0x7f05bc06d8d0 2024-04-01T15:21:58.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.714+0000 7f05c1c00640 1 --2- 172.21.15.142:0/4108358258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc06d8d0 0x7f05bc0b2d20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05b00097a0 tx=0x7f05b002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e1c61691a223ab server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.714+0000 7f05bbe00640 1 -- 172.21.15.142:0/4108358258 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0034070 con 0x7f05bc06d8d0 2024-04-01T15:21:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.714+0000 7f05bbe00640 1 -- 172.21.15.142:0/4108358258 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0030610 con 0x7f05bc06d8d0 2024-04-01T15:21:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.715+0000 7f05bbe00640 1 -- 172.21.15.142:0/4108358258 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b00309e0 con 0x7f05bc06d8d0 2024-04-01T15:21:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.715+0000 7f05c4600640 1 -- 172.21.15.142:0/4108358258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc06d8d0 msgr2=0x7f05bc0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.715+0000 7f05c4600640 1 --2- 172.21.15.142:0/4108358258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc06d8d0 0x7f05bc0b2d20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05b00097a0 tx=0x7f05b002b960 comp rx=0 tx=0).stop 2024-04-01T15:21:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.715+0000 7f05c4600640 1 -- 172.21.15.142:0/4108358258 shutdown_connections 2024-04-01T15:21:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.715+0000 7f05c4600640 1 --2- 172.21.15.142:0/4108358258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc06d8d0 0x7f05bc0b2d20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.715+0000 7f05c4600640 1 -- 172.21.15.142:0/4108358258 >> 172.21.15.142:0/4108358258 conn(0x7f05bc0b5890 msgr2=0x7f05bc0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.715+0000 7f05c4600640 1 -- 172.21.15.142:0/4108358258 shutdown_connections 2024-04-01T15:21:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.715+0000 7f05c4600640 1 -- 172.21.15.142:0/4108358258 wait complete. 2024-04-01T15:21:58.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.717+0000 7f05c4600640 1 Processor -- start 2024-04-01T15:21:58.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.717+0000 7f05c4600640 1 -- start start 2024-04-01T15:21:58.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c4600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05bc06d8d0 0x7f05bc1d2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:58.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c4600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc0b0fb0 0x7f05bc147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:58.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c4600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc0b1410 0x7f05bc1deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c4600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc1498f0 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c4600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc0b4e50 con 0x7f05bc0b1410 2024-04-01T15:21:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c4600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f05bc147380 con 0x7f05bc06d8d0 2024-04-01T15:21:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc0b0fb0 0x7f05bc147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc0b0fb0 0x7f05bc147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59814/0 (socket says 172.21.15.142:59814) 2024-04-01T15:21:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c1200640 1 -- 172.21.15.142:0/2065663412 learned_addr learned my addr 172.21.15.142:0/2065663412 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:58.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.718+0000 7f05c2600640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc0b1410 0x7f05bc1deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:58.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05c1c00640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05bc06d8d0 0x7f05bc1d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05c1200640 1 -- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05bc06d8d0 msgr2=0x7f05bc1d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05c1200640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05bc06d8d0 0x7f05bc1d2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05c1200640 1 -- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc0b1410 msgr2=0x7f05bc1deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05c1200640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc0b1410 0x7f05bc1deda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05c1200640 1 -- 172.21.15.142:0/2065663412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc146e00 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05c1200640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc0b0fb0 0x7f05bc147f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c400 tx=0x7f05a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05b9600640 1 -- 172.21.15.142:0/2065663412 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a80052d0 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05b9600640 1 -- 172.21.15.142:0/2065663412 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a8005490 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc1de950 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05b9600640 1 -- 172.21.15.142:0/2065663412 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8007260 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.719+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05bc1470a0 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.720+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05bc068710 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.721+0000 7f05b9600640 1 -- 172.21.15.142:0/2065663412 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05a8007400 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.722+0000 7f05b9600640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f059c06c8f0 0x7f059c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:58.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.722+0000 7f05b9600640 1 -- 172.21.15.142:0/2065663412 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f05a808b090 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.723+0000 7f05c1c00640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f059c06c8f0 0x7f059c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:58.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.724+0000 7f05c1c00640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f059c06c8f0 0x7f059c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05b0036000 tx=0x7f05b003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:58.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.727+0000 7f05b9600640 1 -- 172.21.15.142:0/2065663412 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f05a80594b0 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.912+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05bc0b88c0 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.914+0000 7f05b9600640 1 -- 172.21.15.142:0/2065663412 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16642 (secure 0 0 0) 0x7f05a8058db0 con 0x7f05bc0b0fb0 2024-04-01T15:21:58.915 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:21:58.915 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":19,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:57.962677+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f059c06c8f0 msgr2=0x7f059c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f059c06c8f0 0x7f059c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05b0036000 tx=0x7f05b003b040 comp rx=0 tx=0).stop 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc0b0fb0 msgr2=0x7f05bc147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc0b0fb0 0x7f05bc147f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c400 tx=0x7f05a800c8c0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 shutdown_connections 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f059c06c8f0 0x7f059c06edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc0b1410 0x7f05bc1deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05bc0b0fb0 0x7f05bc147f10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 --2- 172.21.15.142:0/2065663412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05bc06d8d0 0x7f05bc1d2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 >> 172.21.15.142:0/2065663412 conn(0x7f05bc0b5890 msgr2=0x7f05bc0b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 shutdown_connections 2024-04-01T15:21:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:58.917+0000 7f05c4600640 1 -- 172.21.15.142:0/2065663412 wait complete. 2024-04-01T15:21:58.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:21:59.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.130+0000 7fcbe7e00640 1 Processor -- start 2024-04-01T15:21:59.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.130+0000 7fcbe7e00640 1 -- start start 2024-04-01T15:21:59.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.131+0000 7fcbe7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcbe00b2d20 0x7fcbe01491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.131+0000 7fcbe7e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcbe0149720 0x7fcbe014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.131+0000 7fcbe7e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe00b3180 con 0x7fcbe006d8d0 2024-04-01T15:21:59.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.131+0000 7fcbe7e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe00b0b20 con 0x7fcbe00b2d20 2024-04-01T15:21:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.131+0000 7fcbe7e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe006dcb0 con 0x7fcbe0149720 2024-04-01T15:21:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.132+0000 7fcbe4a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcbe00b2d20 0x7fcbe01491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.132+0000 7fcbe4a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcbe00b2d20 0x7fcbe01491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59826/0 (socket says 172.21.15.142:59826) 2024-04-01T15:21:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.132+0000 7fcbe4a00640 1 -- 172.21.15.142:0/3374153796 learned_addr learned my addr 172.21.15.142:0/3374153796 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.132+0000 7fcbe5e00640 1 --2- 172.21.15.142:0/3374153796 >> v2:172.21.15.179:3300/0 conn(0x7fcbe0149720 0x7fcbe014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.132+0000 7fcbe4a00640 1 -- 172.21.15.142:0/3374153796 >> v2:172.21.15.179:3300/0 conn(0x7fcbe0149720 msgr2=0x7fcbe014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.132+0000 7fcbe4a00640 1 --2- 172.21.15.142:0/3374153796 >> v2:172.21.15.179:3300/0 conn(0x7fcbe0149720 0x7fcbe014fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.132+0000 7fcbe4a00640 1 -- 172.21.15.142:0/3374153796 >> v1:172.21.15.179:6789/0 conn(0x7fcbe006d8d0 legacy=0x7fcbe00b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.132+0000 7fcbe4a00640 1 -- 172.21.15.142:0/3374153796 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe0148ad0 con 0x7fcbe00b2d20 2024-04-01T15:21:59.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.133+0000 7fcbe4a00640 1 --2- 172.21.15.142:0/3374153796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe00b2d20 0x7fcbe01491e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00b0ca0 tx=0x7fcbcc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cef3018c2c21827 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:59.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.133+0000 7fcbdfe00640 1 -- 172.21.15.142:0/3374153796 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc02e070 con 0x7fcbe00b2d20 2024-04-01T15:21:59.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.133+0000 7fcbdfe00640 1 -- 172.21.15.142:0/3374153796 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbcc037070 con 0x7fcbe00b2d20 2024-04-01T15:21:59.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.133+0000 7fcbdfe00640 1 -- 172.21.15.142:0/3374153796 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc031a00 con 0x7fcbe00b2d20 2024-04-01T15:21:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.134+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3374153796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe00b2d20 msgr2=0x7fcbe01491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.134+0000 7fcbe7e00640 1 --2- 172.21.15.142:0/3374153796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe00b2d20 0x7fcbe01491e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00b0ca0 tx=0x7fcbcc02b880 comp rx=0 tx=0).stop 2024-04-01T15:21:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.134+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3374153796 shutdown_connections 2024-04-01T15:21:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.134+0000 7fcbe7e00640 1 --2- 172.21.15.142:0/3374153796 >> v2:172.21.15.179:3300/0 conn(0x7fcbe0149720 0x7fcbe014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.134+0000 7fcbe7e00640 1 --2- 172.21.15.142:0/3374153796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe00b2d20 0x7fcbe01491e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.134+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3374153796 >> 172.21.15.142:0/3374153796 conn(0x7fcbe00b5890 msgr2=0x7fcbe00b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.134+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3374153796 shutdown_connections 2024-04-01T15:21:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.134+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3374153796 wait complete. 2024-04-01T15:21:59.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.136+0000 7fcbe7e00640 1 Processor -- start 2024-04-01T15:21:59.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.136+0000 7fcbe7e00640 1 -- start start 2024-04-01T15:21:59.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe006d8d0 0x7fcbe0070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe7e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe00b2d20 0x7fcbe01e1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe7e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe0149720 0x7fcbe01e1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00b16c0 con 0x7fcbe006d8d0 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe7e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00b5510 con 0x7fcbe0149720 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe7e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe00b4e50 con 0x7fcbe00b2d20 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe006d8d0 0x7fcbe0070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe006d8d0 0x7fcbe0070730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59828/0 (socket says 172.21.15.142:59828) 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5400640 1 -- 172.21.15.142:0/3400969651 learned_addr learned my addr 172.21.15.142:0/3400969651 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe4a00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe00b2d20 0x7fcbe01e1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5e00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe0149720 0x7fcbe01e1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5400640 1 -- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe00b2d20 msgr2=0x7fcbe01e1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5400640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe00b2d20 0x7fcbe01e1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5400640 1 -- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe0149720 msgr2=0x7fcbe01e1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5400640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe0149720 0x7fcbe01e1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5400640 1 -- 172.21.15.142:0/3400969651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe01457c0 con 0x7fcbe006d8d0 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.137+0000 7fcbe5e00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe0149720 0x7fcbe01e1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:21:59.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.138+0000 7fcbe5400640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe006d8d0 0x7fcbe0070730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400ba50 tx=0x7fcbd400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:59.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.138+0000 7fcbdd600640 1 -- 172.21.15.142:0/3400969651 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4019070 con 0x7fcbe006d8d0 2024-04-01T15:21:59.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.138+0000 7fcbdd600640 1 -- 172.21.15.142:0/3400969651 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd400cc20 con 0x7fcbe006d8d0 2024-04-01T15:21:59.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.138+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe0071000 con 0x7fcbe006d8d0 2024-04-01T15:21:59.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.138+0000 7fcbdd600640 1 -- 172.21.15.142:0/3400969651 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4014680 con 0x7fcbe006d8d0 2024-04-01T15:21:59.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.138+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe00721b0 con 0x7fcbe006d8d0 2024-04-01T15:21:59.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.139+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe00b25b0 con 0x7fcbe006d8d0 2024-04-01T15:21:59.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.140+0000 7fcbdd600640 1 -- 172.21.15.142:0/3400969651 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcbd401c070 con 0x7fcbe006d8d0 2024-04-01T15:21:59.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.141+0000 7fcbdd600640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcbc006c8f0 0x7fcbc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.142+0000 7fcbdd600640 1 -- 172.21.15.142:0/3400969651 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fcbd408b760 con 0x7fcbe006d8d0 2024-04-01T15:21:59.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.142+0000 7fcbe4a00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcbc006c8f0 0x7fcbc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.143+0000 7fcbe4a00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcbc006c8f0 0x7fcbc006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc036000 tx=0x7fcbcc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:59.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.146+0000 7fcbdd600640 1 -- 172.21.15.142:0/3400969651 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcbe00b25b0 con 0x7fcbe006d8d0 2024-04-01T15:21:59.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.332+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbe01e0db0 con 0x7fcbe006d8d0 2024-04-01T15:21:59.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.335+0000 7fcbdd600640 1 -- 172.21.15.142:0/3400969651 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16642 (secure 0 0 0) 0x7fcbe01e0db0 con 0x7fcbe006d8d0 2024-04-01T15:21:59.336 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:21:59.336 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":19,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:57.962677+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:21:59.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcbc006c8f0 msgr2=0x7fcbc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:59.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcbc006c8f0 0x7fcbc006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc036000 tx=0x7fcbcc008030 comp rx=0 tx=0).stop 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe006d8d0 msgr2=0x7fcbe0070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe006d8d0 0x7fcbe0070730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400ba50 tx=0x7fcbd400bf10 comp rx=0 tx=0).stop 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 shutdown_connections 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcbc006c8f0 0x7fcbc006edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe0149720 0x7fcbe01e1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe00b2d20 0x7fcbe01e1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 --2- 172.21.15.142:0/3400969651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe006d8d0 0x7fcbe0070730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 >> 172.21.15.142:0/3400969651 conn(0x7fcbe00b5890 msgr2=0x7fcbe00b6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 shutdown_connections 2024-04-01T15:21:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.338+0000 7fcbe7e00640 1 -- 172.21.15.142:0/3400969651 wait complete. 2024-04-01T15:21:59.357 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-01T15:21:59.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.555+0000 7fbe98000640 1 Processor -- start 2024-04-01T15:21:59.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.555+0000 7fbe98000640 1 -- start start 2024-04-01T15:21:59.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.556+0000 7fbe98000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbe900af200 0x7fbe9014f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.556+0000 7fbe98000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9014f870 0x7fbe9014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.556+0000 7fbe98000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe900b56b0 con 0x7fbe9006d8d0 2024-04-01T15:21:59.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.556+0000 7fbe98000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fbe900ae660 con 0x7fbe900af200 2024-04-01T15:21:59.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.556+0000 7fbe98000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbe900b03c0 con 0x7fbe9014f870 2024-04-01T15:21:59.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.557+0000 7fbe96000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9014f870 0x7fbe9014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.557+0000 7fbe94c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbe900af200 0x7fbe9014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.557+0000 7fbe96000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9014f870 0x7fbe9014fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:39020/0 (socket says 172.21.15.142:39020) 2024-04-01T15:21:59.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.557+0000 7fbe96000640 1 -- 172.21.15.142:0/2249329697 learned_addr learned my addr 172.21.15.142:0/2249329697 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:59.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.558+0000 7fbe94c00640 1 -- 172.21.15.142:0/2249329697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9014f870 msgr2=0x7fbe9014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:21:59.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.558+0000 7fbe94c00640 1 --2- 172.21.15.142:0/2249329697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9014f870 0x7fbe9014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.558+0000 7fbe94c00640 1 -- 172.21.15.142:0/2249329697 >> v1:172.21.15.179:6789/0 conn(0x7fbe9006d8d0 legacy=0x7fbe900aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:59.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.558+0000 7fbe94c00640 1 -- 172.21.15.142:0/2249329697 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9006dcb0 con 0x7fbe900af200 2024-04-01T15:21:59.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.559+0000 7fbe94c00640 1 --2- 172.21.15.142:0/2249329697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe900af200 0x7fbe9014f330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0097d0 tx=0x7fbe7c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55097062693e41cc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:59.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.559+0000 7fbe8fe00640 1 -- 172.21.15.142:0/2249329697 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c039070 con 0x7fbe900af200 2024-04-01T15:21:59.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.560+0000 7fbe8fe00640 1 -- 172.21.15.142:0/2249329697 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7c0316f0 con 0x7fbe900af200 2024-04-01T15:21:59.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.560+0000 7fbe8fe00640 1 -- 172.21.15.142:0/2249329697 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c031ac0 con 0x7fbe900af200 2024-04-01T15:21:59.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.560+0000 7fbe98000640 1 -- 172.21.15.142:0/2249329697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe900af200 msgr2=0x7fbe9014f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:59.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.560+0000 7fbe98000640 1 --2- 172.21.15.142:0/2249329697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe900af200 0x7fbe9014f330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0097d0 tx=0x7fbe7c02b790 comp rx=0 tx=0).stop 2024-04-01T15:21:59.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.560+0000 7fbe98000640 1 -- 172.21.15.142:0/2249329697 shutdown_connections 2024-04-01T15:21:59.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.560+0000 7fbe98000640 1 --2- 172.21.15.142:0/2249329697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9014f870 0x7fbe9014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.560+0000 7fbe98000640 1 --2- 172.21.15.142:0/2249329697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe900af200 0x7fbe9014f330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.560+0000 7fbe98000640 1 -- 172.21.15.142:0/2249329697 >> 172.21.15.142:0/2249329697 conn(0x7fbe900b5890 msgr2=0x7fbe900b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:21:59.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.560+0000 7fbe98000640 1 -- 172.21.15.142:0/2249329697 shutdown_connections 2024-04-01T15:21:59.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.561+0000 7fbe98000640 1 -- 172.21.15.142:0/2249329697 wait complete. 2024-04-01T15:21:59.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.562+0000 7fbe98000640 1 Processor -- start 2024-04-01T15:21:59.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.562+0000 7fbe98000640 1 -- start start 2024-04-01T15:21:59.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.563+0000 7fbe98000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe9006d8d0 0x7fbe90148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.563+0000 7fbe98000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe900af200 0x7fbe901e1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.563+0000 7fbe98000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe9014f870 0x7fbe90148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.563+0000 7fbe98000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900afd70 con 0x7fbe9014f870 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.563+0000 7fbe98000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900b53d0 con 0x7fbe9006d8d0 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.563+0000 7fbe98000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbe900b3210 con 0x7fbe900af200 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe96000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe9014f870 0x7fbe90148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe95600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe9006d8d0 0x7fbe90148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe96000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe9014f870 0x7fbe90148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59830/0 (socket says 172.21.15.142:59830) 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe96000640 1 -- 172.21.15.142:0/2438047230 learned_addr learned my addr 172.21.15.142:0/2438047230 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe94c00640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe900af200 0x7fbe901e1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe96000640 1 -- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe900af200 msgr2=0x7fbe901e1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe96000640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe900af200 0x7fbe901e1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe96000640 1 -- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe9006d8d0 msgr2=0x7fbe90148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:21:59.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe96000640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe9006d8d0 0x7fbe90148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:21:59.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe96000640 1 -- 172.21.15.142:0/2438047230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe90146a90 con 0x7fbe9014f870 2024-04-01T15:21:59.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.564+0000 7fbe96000640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe9014f870 0x7fbe90148ba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800efc0 tx=0x7fbe8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:59.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.565+0000 7fbe8d600640 1 -- 172.21.15.142:0/2438047230 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800cd20 con 0x7fbe9014f870 2024-04-01T15:21:59.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.565+0000 7fbe8d600640 1 -- 172.21.15.142:0/2438047230 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88003990 con 0x7fbe9014f870 2024-04-01T15:21:59.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.565+0000 7fbe8d600640 1 -- 172.21.15.142:0/2438047230 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88003d80 con 0x7fbe9014f870 2024-04-01T15:21:59.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.565+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe901e1320 con 0x7fbe9014f870 2024-04-01T15:21:59.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.565+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe90149640 con 0x7fbe9014f870 2024-04-01T15:21:59.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.566+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe901e1500 con 0x7fbe9014f870 2024-04-01T15:21:59.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.567+0000 7fbe8d600640 1 -- 172.21.15.142:0/2438047230 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe88005d10 con 0x7fbe9014f870 2024-04-01T15:21:59.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.567+0000 7fbe8d600640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fbe7006c8f0 0x7fbe7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:21:59.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.568+0000 7fbe8d600640 1 -- 172.21.15.142:0/2438047230 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe8808bfc0 con 0x7fbe9014f870 2024-04-01T15:21:59.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.568+0000 7fbe95600640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fbe7006c8f0 0x7fbe7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:21:59.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.569+0000 7fbe95600640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fbe7006c8f0 0x7fbe7006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe840016e0 tx=0x7fbe84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:21:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.572+0000 7fbe8d600640 1 -- 172.21.15.142:0/2438047230 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbe88022020 con 0x7fbe9014f870 2024-04-01T15:21:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:21:59.814+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbe90068710 con 0x7fbe9014f870 2024-04-01T15:22:00.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.532+0000 7fbe8d600640 1 -- 172.21.15.142:0/2438047230 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fbe901e1320 con 0x7fbe9014f870 2024-04-01T15:22:00.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.535+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fbe7006c8f0 msgr2=0x7fbe7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:00.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.535+0000 7fbe98000640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fbe7006c8f0 0x7fbe7006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe840016e0 tx=0x7fbe84009040 comp rx=0 tx=0).stop 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.535+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe9014f870 msgr2=0x7fbe90148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.536+0000 7fbe98000640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe9014f870 0x7fbe90148ba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800efc0 tx=0x7fbe8800c490 comp rx=0 tx=0).stop 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.536+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 shutdown_connections 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.536+0000 7fbe98000640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fbe7006c8f0 0x7fbe7006edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.536+0000 7fbe98000640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe9014f870 0x7fbe90148ba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.536+0000 7fbe98000640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe900af200 0x7fbe901e1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.536+0000 7fbe98000640 1 --2- 172.21.15.142:0/2438047230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe9006d8d0 0x7fbe90148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.536+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 >> 172.21.15.142:0/2438047230 conn(0x7fbe900b5890 msgr2=0x7fbe9006cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.536+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 shutdown_connections 2024-04-01T15:22:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.536+0000 7fbe98000640 1 -- 172.21.15.142:0/2438047230 wait complete. 2024-04-01T15:22:00.559 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-01T15:22:00.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-01T15:22:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.769+0000 7fb11ea00640 1 Processor -- start 2024-04-01T15:22:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.769+0000 7fb11ea00640 1 -- start start 2024-04-01T15:22:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.770+0000 7fb11ea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1180af060 0x7fb1180b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.770+0000 7fb11ea00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb1180b1f20 0x7fb1180b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.770+0000 7fb11ea00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1180b12e0 con 0x7fb11806d740 2024-04-01T15:22:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.770+0000 7fb11ea00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb1180b55b0 con 0x7fb1180af060 2024-04-01T15:22:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.770+0000 7fb11ea00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fb1180b5120 con 0x7fb1180b1f20 2024-04-01T15:22:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.771+0000 7fb11cc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1180af060 0x7fb1180b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.771+0000 7fb11cc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1180af060 0x7fb1180b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59832/0 (socket says 172.21.15.142:59832) 2024-04-01T15:22:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.771+0000 7fb11cc00640 1 -- 172.21.15.142:0/3293178457 learned_addr learned my addr 172.21.15.142:0/3293178457 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.771+0000 7fb11e000640 1 --2- 172.21.15.142:0/3293178457 >> v2:172.21.15.179:3300/0 conn(0x7fb1180b1f20 0x7fb1180b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.771+0000 7fb11cc00640 1 -- 172.21.15.142:0/3293178457 >> v2:172.21.15.179:3300/0 conn(0x7fb1180b1f20 msgr2=0x7fb1180b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.771+0000 7fb11cc00640 1 --2- 172.21.15.142:0/3293178457 >> v2:172.21.15.179:3300/0 conn(0x7fb1180b1f20 0x7fb1180b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.771+0000 7fb11cc00640 1 -- 172.21.15.142:0/3293178457 >> v1:172.21.15.179:6789/0 conn(0x7fb11806d740 legacy=0x7fb1180af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.771+0000 7fb11cc00640 1 -- 172.21.15.142:0/3293178457 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1180b28b0 con 0x7fb1180af060 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.772+0000 7fb11cc00640 1 --2- 172.21.15.142:0/3293178457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 0x7fb1180b19e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb118072da0 tx=0x7fb10402e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8282a37a93be4c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb117e00640 1 -- 172.21.15.142:0/3293178457 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10403b070 con 0x7fb1180af060 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb117e00640 1 -- 172.21.15.142:0/3293178457 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb104036440 con 0x7fb1180af060 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb117e00640 1 -- 172.21.15.142:0/3293178457 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104036810 con 0x7fb1180af060 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb11ea00640 1 -- 172.21.15.142:0/3293178457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 msgr2=0x7fb1180b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb11ea00640 1 --2- 172.21.15.142:0/3293178457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 0x7fb1180b19e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb118072da0 tx=0x7fb10402e170 comp rx=0 tx=0).stop 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb11ea00640 1 -- 172.21.15.142:0/3293178457 shutdown_connections 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb11ea00640 1 --2- 172.21.15.142:0/3293178457 >> v2:172.21.15.179:3300/0 conn(0x7fb1180b1f20 0x7fb1180b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb11ea00640 1 --2- 172.21.15.142:0/3293178457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 0x7fb1180b19e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb11ea00640 1 -- 172.21.15.142:0/3293178457 >> 172.21.15.142:0/3293178457 conn(0x7fb1180b5790 msgr2=0x7fb1180b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb11ea00640 1 -- 172.21.15.142:0/3293178457 shutdown_connections 2024-04-01T15:22:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.773+0000 7fb11ea00640 1 -- 172.21.15.142:0/3293178457 wait complete. 2024-04-01T15:22:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.775+0000 7fb11ea00640 1 Processor -- start 2024-04-01T15:22:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.775+0000 7fb11ea00640 1 -- start start 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11ea00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb11806d740 0x7fb1181382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11ea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 0x7fb1181dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11ea00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b1f20 0x7fb118134fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11ea00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb1180b4df0 con 0x7fb1180af060 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11ea00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1180b1550 con 0x7fb11806d740 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11ea00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb1180b0330 con 0x7fb1180b1f20 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11cc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 0x7fb1181dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11cc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 0x7fb1181dcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59842/0 (socket says 172.21.15.142:59842) 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11cc00640 1 -- 172.21.15.142:0/3154122770 learned_addr learned my addr 172.21.15.142:0/3154122770 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11d600640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb11806d740 0x7fb1181382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11e000640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b1f20 0x7fb118134fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.776+0000 7fb11cc00640 1 -- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b1f20 msgr2=0x7fb118134fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb11cc00640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b1f20 0x7fb118134fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb11cc00640 1 -- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb11806d740 msgr2=0x7fb1181382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb11cc00640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb11806d740 0x7fb1181382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb11cc00640 1 -- 172.21.15.142:0/3154122770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1181437a0 con 0x7fb1180af060 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb11d600640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb11806d740 0x7fb1181382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb11cc00640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 0x7fb1181dcfb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb10402e1b0 tx=0x7fb1040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb115600640 1 -- 172.21.15.142:0/3154122770 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10403b030 con 0x7fb1180af060 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb115600640 1 -- 172.21.15.142:0/3154122770 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10403d070 con 0x7fb1180af060 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb115600640 1 -- 172.21.15.142:0/3154122770 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104034bc0 con 0x7fb1180af060 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb118144f40 con 0x7fb1180af060 2024-04-01T15:22:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.777+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb118142fa0 con 0x7fb1180af060 2024-04-01T15:22:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.778+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1180aee50 con 0x7fb1180af060 2024-04-01T15:22:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.779+0000 7fb115600640 1 -- 172.21.15.142:0/3154122770 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb104048060 con 0x7fb1180af060 2024-04-01T15:22:00.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.780+0000 7fb115600640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb0f806c8f0 0x7fb0f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:00.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.780+0000 7fb115600640 1 -- 172.21.15.142:0/3154122770 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb1040ad8a0 con 0x7fb1180af060 2024-04-01T15:22:00.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.781+0000 7fb11d600640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb0f806c8f0 0x7fb0f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:00.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.782+0000 7fb11d600640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb0f806c8f0 0x7fb0f806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb10c001680 tx=0x7fb10c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:00.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:00.785+0000 7fb115600640 1 -- 172.21.15.142:0/3154122770 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb1180aee50 con 0x7fb1180af060 2024-04-01T15:22:01.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.026+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb118068590 con 0x7fb1180af060 2024-04-01T15:22:01.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.543+0000 7fb115600640 1 -- 172.21.15.142:0/3154122770 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fb10407bcc0 con 0x7fb1180af060 2024-04-01T15:22:01.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb0f806c8f0 msgr2=0x7fb0f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb0f806c8f0 0x7fb0f806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb10c001680 tx=0x7fb10c009040 comp rx=0 tx=0).stop 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 msgr2=0x7fb1181dcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 0x7fb1181dcfb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb10402e1b0 tx=0x7fb1040046c0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 shutdown_connections 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb0f806c8f0 0x7fb0f806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b1f20 0x7fb118134fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1180af060 0x7fb1181dcfb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 --2- 172.21.15.142:0/3154122770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb11806d740 0x7fb1181382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 >> 172.21.15.142:0/3154122770 conn(0x7fb1180b5790 msgr2=0x7fb1181419b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 shutdown_connections 2024-04-01T15:22:01.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.547+0000 7fb11ea00640 1 -- 172.21.15.142:0/3154122770 wait complete. 2024-04-01T15:22:01.570 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-01T15:22:01.570 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T15:22:01.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.775+0000 7f6950400640 1 Processor -- start 2024-04-01T15:22:01.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.775+0000 7f6950400640 1 -- start start 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.776+0000 7f6950400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f694814ee60 0x7f6948151250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.776+0000 7f6950400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69480b3180 con 0x7f694806d8d0 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.776+0000 7f6950400640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694806dcb0 con 0x7f69480b2d20 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.776+0000 7f6950400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f69480b0b20 con 0x7f694814ee60 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f694da00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f694806d8d0 0x7f69480b0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54460/0 (socket says 172.21.15.142:54460) 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f694da00640 1 -- 172.21.15.142:0/4261100292 learned_addr learned my addr 172.21.15.142:0/4261100292 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f694e400640 1 --2- 172.21.15.142:0/4261100292 >> v2:172.21.15.179:3300/0 conn(0x7f694814ee60 0x7f6948151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4135116764 0 0) 0x7f69480b3180 con 0x7f694806d8d0 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6930003520 con 0x7f694806d8d0 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1951206387 0 0) 0x7f6930003520 con 0x7f694806d8d0 2024-04-01T15:22:01.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 >> v2:172.21.15.179:3300/0 conn(0x7f694814ee60 msgr2=0x7f6948151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 --2- 172.21.15.142:0/4261100292 >> v2:172.21.15.179:3300/0 conn(0x7f694814ee60 0x7f6948151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 >> v1:172.21.15.179:6789/0 conn(0x7f69480b2d20 legacy=0x7f69481491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6948148ad0 con 0x7f694806d8d0 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f693c001690 con 0x7f694806d8d0 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 >> v1:172.21.15.142:6789/0 conn(0x7f694806d8d0 legacy=0x7f69480b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f6930003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.777+0000 7f6947e00640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930004800 0x7f6930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f6947e00640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69300051c0 0x7f693000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69480b0b20 con 0x7f6930003a00 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f693000c0c0 con 0x7f6930004800 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f693000c2c0 con 0x7f69300051c0 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f694da00640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f6930003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:01.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f694d000640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930004800 0x7f6930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:01.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f694da00640 1 -- 172.21.15.142:0/4261100292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69300051c0 msgr2=0x7f693000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:01.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f694da00640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69300051c0 0x7f693000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f694da00640 1 -- 172.21.15.142:0/4261100292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930004800 msgr2=0x7f6930004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:01.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f694da00640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930004800 0x7f6930004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f694da00640 1 -- 172.21.15.142:0/4261100292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6930003520 con 0x7f6930003a00 2024-04-01T15:22:01.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.778+0000 7f694e400640 1 -- 172.21.15.142:0/4261100292 reap_dead start 2024-04-01T15:22:01.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.779+0000 7f694da00640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f6930003e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69480b3350 tx=0x7f6930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8023c8ba5a1182bf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:01.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.779+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c007c80 con 0x7f6930003a00 2024-04-01T15:22:01.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.779+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c030070 con 0x7f6930003a00 2024-04-01T15:22:01.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.779+0000 7f6947e00640 1 -- 172.21.15.142:0/4261100292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c005d10 con 0x7f6930003a00 2024-04-01T15:22:01.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.780+0000 7f6950400640 1 -- 172.21.15.142:0/4261100292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 msgr2=0x7f6930003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:01.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.780+0000 7f6950400640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f6930003e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69480b3350 tx=0x7f6930005830 comp rx=0 tx=0).stop 2024-04-01T15:22:01.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.780+0000 7f6950400640 1 -- 172.21.15.142:0/4261100292 shutdown_connections 2024-04-01T15:22:01.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.780+0000 7f6950400640 1 --2- 172.21.15.142:0/4261100292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f6930003e20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.780+0000 7f6950400640 1 -- 172.21.15.142:0/4261100292 >> 172.21.15.142:0/4261100292 conn(0x7f69480b5890 msgr2=0x7f69480b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.780+0000 7f6950400640 1 -- 172.21.15.142:0/4261100292 shutdown_connections 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.780+0000 7f6950400640 1 -- 172.21.15.142:0/4261100292 wait complete. 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.782+0000 7f6950400640 1 Processor -- start 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.782+0000 7f6950400640 1 -- start start 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.782+0000 7f6950400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f69481413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f6950400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69480726e0 0x7f694813ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f6950400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69481deeb0 0x7f6948142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f6950400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69480b4e50 con 0x7f6930003a00 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f6950400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f69480b5510 con 0x7f69481deeb0 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f6950400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f69480b4fd0 con 0x7f69480726e0 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694da00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f69481413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694da00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f69481413e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59864/0 (socket says 172.21.15.142:59864) 2024-04-01T15:22:01.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694da00640 1 -- 172.21.15.142:0/3812200527 learned_addr learned my addr 172.21.15.142:0/3812200527 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:01.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694d000640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69480726e0 0x7f694813ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:01.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694e400640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69481deeb0 0x7f6948142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:01.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694da00640 1 -- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69480726e0 msgr2=0x7f694813ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:01.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694da00640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69480726e0 0x7f694813ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694da00640 1 -- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69481deeb0 msgr2=0x7f6948142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:01.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694da00640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69481deeb0 0x7f6948142300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:01.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694da00640 1 -- 172.21.15.142:0/3812200527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6948142840 con 0x7f6930003a00 2024-04-01T15:22:01.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.783+0000 7f694da00640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f69481413e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f693c02c3b0 tx=0x7f693c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:01.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.784+0000 7f6945600640 1 -- 172.21.15.142:0/3812200527 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c046070 con 0x7f6930003a00 2024-04-01T15:22:01.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.784+0000 7f6945600640 1 -- 172.21.15.142:0/3812200527 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c007480 con 0x7f6930003a00 2024-04-01T15:22:01.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.784+0000 7f6945600640 1 -- 172.21.15.142:0/3812200527 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c007c60 con 0x7f6930003a00 2024-04-01T15:22:01.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.784+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6948141d50 con 0x7f6930003a00 2024-04-01T15:22:01.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.784+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6948141a70 con 0x7f6930003a00 2024-04-01T15:22:01.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.785+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69481de7a0 con 0x7f6930003a00 2024-04-01T15:22:01.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.786+0000 7f6945600640 1 -- 172.21.15.142:0/3812200527 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f693c049070 con 0x7f6930003a00 2024-04-01T15:22:01.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.787+0000 7f6945600640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f692806c8f0 0x7f692806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:01.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.787+0000 7f6945600640 1 -- 172.21.15.142:0/3812200527 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f693c0acdf0 con 0x7f6930003a00 2024-04-01T15:22:01.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.788+0000 7f694d000640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f692806c8f0 0x7f692806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:01.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.789+0000 7f694d000640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f692806c8f0 0x7f692806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6948148650 tx=0x7f6934009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:01.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:01.792+0000 7f6945600640 1 -- 172.21.15.142:0/3812200527 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6948142840 con 0x7f6930003a00 2024-04-01T15:22:02.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.025+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69481447a0 con 0x7f6930003a00 2024-04-01T15:22:02.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.026+0000 7f6945600640 1 -- 172.21.15.142:0/3812200527 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3533 (secure 0 0 0) 0x7f693c07b290 con 0x7f6930003a00 2024-04-01T15:22:02.028 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:02.028 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1407766362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1407766362},{"type":"v1","addr":"172.21.15.142:6833","nonce":1407766362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T15:21:57.963541+0000","modified":"2024-04-01T15:22:01.028534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1191595510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1191595510},{"type":"v1","addr":"172.21.15.179:6835","nonce":1191595510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T15:22:02.028 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f692806c8f0 msgr2=0x7f692806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f692806c8f0 0x7f692806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6948148650 tx=0x7f6934009040 comp rx=0 tx=0).stop 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 msgr2=0x7f69481413e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f69481413e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f693c02c3b0 tx=0x7f693c02e070 comp rx=0 tx=0).stop 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 shutdown_connections 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f692806c8f0 0x7f692806edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69481deeb0 0x7f6948142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69480726e0 0x7f694813ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 --2- 172.21.15.142:0/3812200527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6930003a00 0x7f69481413e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 >> 172.21.15.142:0/3812200527 conn(0x7f69480b5890 msgr2=0x7f6948143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 shutdown_connections 2024-04-01T15:22:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.029+0000 7f6950400640 1 -- 172.21.15.142:0/3812200527 wait complete. 2024-04-01T15:22:02.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:22:02.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.250+0000 7fa877800640 1 Processor -- start 2024-04-01T15:22:02.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.250+0000 7fa877800640 1 -- start start 2024-04-01T15:22:02.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.251+0000 7fa877800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa8700b5990 0x7fa87014b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.251+0000 7fa877800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87006f1d0 con 0x7fa87006d5b0 2024-04-01T15:22:02.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.251+0000 7fa877800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87006dab0 con 0x7fa87006edf0 2024-04-01T15:22:02.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.251+0000 7fa877800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa87006dd90 con 0x7fa8700b5990 2024-04-01T15:22:02.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.252+0000 7fa875800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa87006d5b0 0x7fa8701520d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54472/0 (socket says 172.21.15.142:54472) 2024-04-01T15:22:02.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.252+0000 7fa875800640 1 -- 172.21.15.142:0/3413984134 learned_addr learned my addr 172.21.15.142:0/3413984134 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:02.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.252+0000 7fa867e00640 1 --2- 172.21.15.142:0/3413984134 >> v2:172.21.15.179:3300/0 conn(0x7fa8700b5990 0x7fa87014b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.252+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952592330 0 0) 0x7fa87006f1d0 con 0x7fa87006d5b0 2024-04-01T15:22:02.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.252+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa854003520 con 0x7fa87006d5b0 2024-04-01T15:22:02.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.252+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3380608654 0 0) 0x7fa854003520 con 0x7fa87006d5b0 2024-04-01T15:22:02.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.252+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 >> v2:172.21.15.179:3300/0 conn(0x7fa8700b5990 msgr2=0x7fa87014b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:02.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.252+0000 7fa86fe00640 1 --2- 172.21.15.142:0/3413984134 >> v2:172.21.15.179:3300/0 conn(0x7fa8700b5990 0x7fa87014b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 >> v1:172.21.15.179:6789/0 conn(0x7fa87006edf0 legacy=0x7fa8701449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa870145100 con 0x7fa87006d5b0 2024-04-01T15:22:02.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7fa868001670 con 0x7fa87006d5b0 2024-04-01T15:22:02.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 >> v1:172.21.15.142:6789/0 conn(0x7fa87006d5b0 legacy=0x7fa8701520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa854003a00 0x7fa854003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa854004800 0x7fa854004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa854005210 0x7fa85400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa87006dd90 con 0x7fa854004800 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa85400c160 con 0x7fa854003a00 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa85400c360 con 0x7fa854005210 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa867e00640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa854004800 0x7fa854004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa874e00640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa854003a00 0x7fa854003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa867e00640 1 -- 172.21.15.142:0/3413984134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa854005210 msgr2=0x7fa85400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa867e00640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa854005210 0x7fa85400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa867e00640 1 -- 172.21.15.142:0/3413984134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa854003a00 msgr2=0x7fa854003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa867e00640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa854003a00 0x7fa854003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa867e00640 1 -- 172.21.15.142:0/3413984134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa854003520 con 0x7fa854004800 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.253+0000 7fa875800640 1 -- 172.21.15.142:0/3413984134 reap_dead start 2024-04-01T15:22:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.254+0000 7fa867e00640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa854004800 0x7fa854004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa87006f980 tx=0x7fa854005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a465ffc4b760321f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858039070 con 0x7fa854004800 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85802c630 con 0x7fa854004800 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa86fe00640 1 -- 172.21.15.142:0/3413984134 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858009670 con 0x7fa854004800 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa877800640 1 -- 172.21.15.142:0/3413984134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa854004800 msgr2=0x7fa854004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa877800640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa854004800 0x7fa854004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa87006f980 tx=0x7fa854005830 comp rx=0 tx=0).stop 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa877800640 1 -- 172.21.15.142:0/3413984134 shutdown_connections 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa877800640 1 --2- 172.21.15.142:0/3413984134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa854004800 0x7fa854004c80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa877800640 1 -- 172.21.15.142:0/3413984134 >> 172.21.15.142:0/3413984134 conn(0x7fa8700bb380 msgr2=0x7fa8700bb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa877800640 1 -- 172.21.15.142:0/3413984134 shutdown_connections 2024-04-01T15:22:02.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.255+0000 7fa877800640 1 -- 172.21.15.142:0/3413984134 wait complete. 2024-04-01T15:22:02.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.257+0000 7fa877800640 1 Processor -- start 2024-04-01T15:22:02.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.257+0000 7fa877800640 1 -- start start 2024-04-01T15:22:02.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa877800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa854004800 0x7fa8700b9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa877800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8701dd370 0x7fa8701dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa877800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8701e08e0 0x7fa8701e0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa877800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa870144b70 con 0x7fa8701e08e0 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa877800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa8701449f0 con 0x7fa8701dd370 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa877800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa870144cf0 con 0x7fa854004800 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa875800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8701e08e0 0x7fa8701e0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa875800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8701e08e0 0x7fa8701e0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59886/0 (socket says 172.21.15.142:59886) 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa875800640 1 -- 172.21.15.142:0/489933255 learned_addr learned my addr 172.21.15.142:0/489933255 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa874e00640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa854004800 0x7fa8700b9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa867e00640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8701dd370 0x7fa8701dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa875800640 1 -- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa854004800 msgr2=0x7fa8700b9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa875800640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa854004800 0x7fa8700b9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa875800640 1 -- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8701dd370 msgr2=0x7fa8701dd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa875800640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8701dd370 0x7fa8701dd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.258+0000 7fa875800640 1 -- 172.21.15.142:0/489933255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa870148380 con 0x7fa8701e08e0 2024-04-01T15:22:02.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.259+0000 7fa875800640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8701e08e0 0x7fa8701e0d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa868000fd0 tx=0x7fa86800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:02.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.259+0000 7fa86d600640 1 -- 172.21.15.142:0/489933255 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868007440 con 0x7fa8701e08e0 2024-04-01T15:22:02.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.259+0000 7fa86d600640 1 -- 172.21.15.142:0/489933255 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8680075e0 con 0x7fa8701e08e0 2024-04-01T15:22:02.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.259+0000 7fa86d600640 1 -- 172.21.15.142:0/489933255 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868004a20 con 0x7fa8701e08e0 2024-04-01T15:22:02.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.259+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8700b0150 con 0x7fa8701e08e0 2024-04-01T15:22:02.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.259+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8700b9c10 con 0x7fa8701e08e0 2024-04-01T15:22:02.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.260+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa870068710 con 0x7fa8701e08e0 2024-04-01T15:22:02.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.261+0000 7fa86d600640 1 -- 172.21.15.142:0/489933255 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa868004bc0 con 0x7fa8701e08e0 2024-04-01T15:22:02.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.262+0000 7fa86d600640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa84c06c920 0x7fa84c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.262+0000 7fa86d600640 1 -- 172.21.15.142:0/489933255 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa86808ae60 con 0x7fa8701e08e0 2024-04-01T15:22:02.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.262+0000 7fa874e00640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa84c06c920 0x7fa84c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.263+0000 7fa874e00640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa84c06c920 0x7fa84c06ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa860007fd0 tx=0x7fa860009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:02.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.266+0000 7fa86d600640 1 -- 172.21.15.142:0/489933255 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa86801b070 con 0x7fa8701e08e0 2024-04-01T15:22:02.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.468+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8700b0320 con 0x7fa8701e08e0 2024-04-01T15:22:02.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.469+0000 7fa86d600640 1 -- 172.21.15.142:0/489933255 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fa86801b250 con 0x7fa8701e08e0 2024-04-01T15:22:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:02.471 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":20,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:59.509664+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa84c06c920 msgr2=0x7fa84c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa84c06c920 0x7fa84c06ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa860007fd0 tx=0x7fa860009040 comp rx=0 tx=0).stop 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8701e08e0 msgr2=0x7fa8701e0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8701e08e0 0x7fa8701e0d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa868000fd0 tx=0x7fa86800c8e0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 shutdown_connections 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa84c06c920 0x7fa84c06ede0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8701e08e0 0x7fa8701e0d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8701dd370 0x7fa8701dd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 --2- 172.21.15.142:0/489933255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa854004800 0x7fa8700b9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 >> 172.21.15.142:0/489933255 conn(0x7fa8700bb380 msgr2=0x7fa870142930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:02.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 shutdown_connections 2024-04-01T15:22:02.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.472+0000 7fa877800640 1 -- 172.21.15.142:0/489933255 wait complete. 2024-04-01T15:22:02.491 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-01T15:22:02.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:22:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.696+0000 7f276d600640 1 Processor -- start 2024-04-01T15:22:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.696+0000 7f276d600640 1 -- start start 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.697+0000 7f276d600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f276806d8d0 0x7f27680ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f276d600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27680aedd0 0x7f27681482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f276d600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27680af240 con 0x7f27680b0290 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f276d600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f27680b1790 con 0x7f27680aedd0 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f276d600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f276806dcb0 con 0x7f276806d8d0 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f2767400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27680aedd0 0x7f27681482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f2767400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27680aedd0 0x7f27681482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59896/0 (socket says 172.21.15.142:59896) 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f2767400640 1 -- 172.21.15.142:0/3040553970 learned_addr learned my addr 172.21.15.142:0/3040553970 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f2766a00640 1 --2- 172.21.15.142:0/3040553970 >> v2:172.21.15.179:3300/0 conn(0x7f276806d8d0 0x7f27680ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f2767400640 1 -- 172.21.15.142:0/3040553970 >> v2:172.21.15.179:3300/0 conn(0x7f276806d8d0 msgr2=0x7f27680ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:02.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f2767400640 1 --2- 172.21.15.142:0/3040553970 >> v2:172.21.15.179:3300/0 conn(0x7f276806d8d0 0x7f27680ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.698+0000 7f2767400640 1 -- 172.21.15.142:0/3040553970 >> v1:172.21.15.179:6789/0 conn(0x7f27680b0290 legacy=0x7f2768147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:02.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.699+0000 7f2767400640 1 -- 172.21.15.142:0/3040553970 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27680b14b0 con 0x7f27680aedd0 2024-04-01T15:22:02.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.700+0000 7f2767400640 1 --2- 172.21.15.142:0/3040553970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 0x7f27681482f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f27680b4e40 tx=0x7f276002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1c7037a3a8ebe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:02.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.700+0000 7f2765600640 1 -- 172.21.15.142:0/3040553970 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276002c9f0 con 0x7f27680aedd0 2024-04-01T15:22:02.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.700+0000 7f2765600640 1 -- 172.21.15.142:0/3040553970 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276002cb90 con 0x7f27680aedd0 2024-04-01T15:22:02.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.700+0000 7f2765600640 1 -- 172.21.15.142:0/3040553970 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27600343f0 con 0x7f27680aedd0 2024-04-01T15:22:02.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.701+0000 7f276d600640 1 -- 172.21.15.142:0/3040553970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 msgr2=0x7f27681482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.701+0000 7f276d600640 1 --2- 172.21.15.142:0/3040553970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 0x7f27681482f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f27680b4e40 tx=0x7f276002be50 comp rx=0 tx=0).stop 2024-04-01T15:22:02.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.701+0000 7f276d600640 1 -- 172.21.15.142:0/3040553970 shutdown_connections 2024-04-01T15:22:02.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.701+0000 7f276d600640 1 --2- 172.21.15.142:0/3040553970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 0x7f27681482f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.701+0000 7f276d600640 1 --2- 172.21.15.142:0/3040553970 >> v2:172.21.15.179:3300/0 conn(0x7f276806d8d0 0x7f27680ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.701+0000 7f276d600640 1 -- 172.21.15.142:0/3040553970 >> 172.21.15.142:0/3040553970 conn(0x7f27680b5890 msgr2=0x7f27680b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:02.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.701+0000 7f276d600640 1 -- 172.21.15.142:0/3040553970 shutdown_connections 2024-04-01T15:22:02.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.701+0000 7f276d600640 1 -- 172.21.15.142:0/3040553970 wait complete. 2024-04-01T15:22:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.703+0000 7f276d600640 1 Processor -- start 2024-04-01T15:22:02.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.703+0000 7f276d600640 1 -- start start 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.704+0000 7f276d600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f276806d8d0 0x7f27681c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.704+0000 7f276d600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 0x7f27681db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.704+0000 7f276d600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27680b0290 0x7f27681cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.704+0000 7f276d600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f27680ae090 con 0x7f27680aedd0 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.704+0000 7f276d600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f27680addb0 con 0x7f27680b0290 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.704+0000 7f276d600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f27680ae370 con 0x7f276806d8d0 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.704+0000 7f2766000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 0x7f27681db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.704+0000 7f2766000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 0x7f27681db0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59910/0 (socket says 172.21.15.142:59910) 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.704+0000 7f2766000640 1 -- 172.21.15.142:0/1807276819 learned_addr learned my addr 172.21.15.142:0/1807276819 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f2767400640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27680b0290 0x7f27681cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f2766a00640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f276806d8d0 0x7f27681c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f2766000640 1 -- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f276806d8d0 msgr2=0x7f27681c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f2766000640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f276806d8d0 0x7f27681c3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f2766000640 1 -- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27680b0290 msgr2=0x7f27681cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f2766000640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27680b0290 0x7f27681cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f2766000640 1 -- 172.21.15.142:0/1807276819 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27681ccf70 con 0x7f27680aedd0 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f2766a00640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f276806d8d0 0x7f27681c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f2766000640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 0x7f27681db0b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f275400c430 tx=0x7f275400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f275ea00640 1 -- 172.21.15.142:0/1807276819 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754011790 con 0x7f27680aedd0 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f275ea00640 1 -- 172.21.15.142:0/1807276819 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2754017070 con 0x7f27680aedd0 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f275ea00640 1 -- 172.21.15.142:0/1807276819 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754011bb0 con 0x7f27680aedd0 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2768071b20 con 0x7f27680aedd0 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.705+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27681c4400 con 0x7f27680aedd0 2024-04-01T15:22:02.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.707+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2768068710 con 0x7f27680aedd0 2024-04-01T15:22:02.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.708+0000 7f275ea00640 1 -- 172.21.15.142:0/1807276819 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f275401c460 con 0x7f27680aedd0 2024-04-01T15:22:02.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.708+0000 7f275ea00640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f274806c8f0 0x7f274806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:02.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.709+0000 7f275ea00640 1 -- 172.21.15.142:0/1807276819 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f275408b9e0 con 0x7f27680aedd0 2024-04-01T15:22:02.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.709+0000 7f2766a00640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f274806c8f0 0x7f274806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:02.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.710+0000 7f2766a00640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f274806c8f0 0x7f274806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2758006fd0 tx=0x7f2758008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:02.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.713+0000 7f275ea00640 1 -- 172.21.15.142:0/1807276819 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2754059ea0 con 0x7f27680aedd0 2024-04-01T15:22:02.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.908+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f276806fef0 con 0x7f274806c8f0 2024-04-01T15:22:02.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.931+0000 7f275ea00640 1 -- 172.21.15.142:0/1807276819 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f276806fef0 con 0x7f274806c8f0 2024-04-01T15:22:02.936 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:02.938 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:22:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f274806c8f0 msgr2=0x7f274806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f274806c8f0 0x7f274806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2758006fd0 tx=0x7f2758008040 comp rx=0 tx=0).stop 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 msgr2=0x7f27681db0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 0x7f27681db0b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f275400c430 tx=0x7f275400c8f0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 shutdown_connections 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f274806c8f0 0x7f274806edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27680b0290 0x7f27681cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27680aedd0 0x7f27681db0b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 --2- 172.21.15.142:0/1807276819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f276806d8d0 0x7f27681c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.936+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 >> 172.21.15.142:0/1807276819 conn(0x7f27680b5890 msgr2=0x7f276806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.937+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 shutdown_connections 2024-04-01T15:22:02.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:02.937+0000 7f276d600640 1 -- 172.21.15.142:0/1807276819 wait complete. 2024-04-01T15:22:02.957 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-01T15:22:02.557998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001978"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374534+0000","last_change":"2024-04-01T15:21:58.539004+0000","last_active":"2024-04-01T15:22:00.374534+0000","last_peered":"2024-04-01T15:22:00.374534+0000","last_clean":"2024-04-01T15:22:00.374534+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:22:00.374534+0000","last_undegraded":"2024-04-01T15:22:00.374534+0000","last_fullsized":"2024-04-01T15:22:00.374534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525492+0000","last_change":"2024-04-01T15:21:58.524238+0000","last_active":"2024-04-01T15:21:59.525492+0000","last_peered":"2024-04-01T15:21:59.525492+0000","last_clean":"2024-04-01T15:21:59.525492+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:21:59.525492+0000","last_undegraded":"2024-04-01T15:21:59.525492+0000","last_fullsized":"2024-04-01T15:21:59.525492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795772+0000","last_change":"2024-04-01T15:21:58.526226+0000","last_active":"2024-04-01T15:22:00.795772+0000","last_peered":"2024-04-01T15:22:00.795772+0000","last_clean":"2024-04-01T15:22:00.795772+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:22:00.795772+0000","last_undegraded":"2024-04-01T15:22:00.795772+0000","last_fullsized":"2024-04-01T15:22:00.795772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528754+0000","last_change":"2024-04-01T15:21:58.541297+0000","last_active":"2024-04-01T15:21:59.528754+0000","last_peered":"2024-04-01T15:21:59.528754+0000","last_clean":"2024-04-01T15:21:59.528754+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:21:59.528754+0000","last_undegraded":"2024-04-01T15:21:59.528754+0000","last_fullsized":"2024-04-01T15:21:59.528754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374212+0000","last_change":"2024-04-01T15:21:58.518814+0000","last_active":"2024-04-01T15:22:00.374212+0000","last_peered":"2024-04-01T15:22:00.374212+0000","last_clean":"2024-04-01T15:22:00.374212+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:22:00.374212+0000","last_undegraded":"2024-04-01T15:22:00.374212+0000","last_fullsized":"2024-04-01T15:22:00.374212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528497+0000","last_change":"2024-04-01T15:21:58.519850+0000","last_active":"2024-04-01T15:21:59.528497+0000","last_peered":"2024-04-01T15:21:59.528497+0000","last_clean":"2024-04-01T15:21:59.528497+0000","last_became_active":"2024-04-01T15:21:58.519517+0000","last_became_peered":"2024-04-01T15:21:58.519517+0000","last_unstale":"2024-04-01T15:21:59.528497+0000","last_undegraded":"2024-04-01T15:21:59.528497+0000","last_fullsized":"2024-04-01T15:21:59.528497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374983+0000","last_change":"2024-04-01T15:21:58.522961+0000","last_active":"2024-04-01T15:22:00.374983+0000","last_peered":"2024-04-01T15:22:00.374983+0000","last_clean":"2024-04-01T15:22:00.374983+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:22:00.374983+0000","last_undegraded":"2024-04-01T15:22:00.374983+0000","last_fullsized":"2024-04-01T15:22:00.374983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:51:33.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696563+0000","last_change":"2024-04-01T15:21:58.530231+0000","last_active":"2024-04-01T15:21:59.696563+0000","last_peered":"2024-04-01T15:21:59.696563+0000","last_clean":"2024-04-01T15:21:59.696563+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:21:59.696563+0000","last_undegraded":"2024-04-01T15:21:59.696563+0000","last_fullsized":"2024-04-01T15:21:59.696563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374727+0000","last_change":"2024-04-01T15:21:58.526959+0000","last_active":"2024-04-01T15:22:00.374727+0000","last_peered":"2024-04-01T15:22:00.374727+0000","last_clean":"2024-04-01T15:22:00.374727+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:22:00.374727+0000","last_undegraded":"2024-04-01T15:22:00.374727+0000","last_fullsized":"2024-04-01T15:22:00.374727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175156+0000","last_change":"2024-04-01T15:21:58.529489+0000","last_active":"2024-04-01T15:22:00.175156+0000","last_peered":"2024-04-01T15:22:00.175156+0000","last_clean":"2024-04-01T15:22:00.175156+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:22:00.175156+0000","last_undegraded":"2024-04-01T15:22:00.175156+0000","last_fullsized":"2024-04-01T15:22:00.175156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174888+0000","last_change":"2024-04-01T15:21:58.527803+0000","last_active":"2024-04-01T15:22:00.174888+0000","last_peered":"2024-04-01T15:22:00.174888+0000","last_clean":"2024-04-01T15:22:00.174888+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:22:00.174888+0000","last_undegraded":"2024-04-01T15:22:00.174888+0000","last_fullsized":"2024-04-01T15:22:00.174888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525348+0000","last_change":"2024-04-01T15:21:58.535848+0000","last_active":"2024-04-01T15:21:59.525348+0000","last_peered":"2024-04-01T15:21:59.525348+0000","last_clean":"2024-04-01T15:21:59.525348+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:21:59.525348+0000","last_undegraded":"2024-04-01T15:21:59.525348+0000","last_fullsized":"2024-04-01T15:21:59.525348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697039+0000","last_change":"2024-04-01T15:21:58.528912+0000","last_active":"2024-04-01T15:21:59.697039+0000","last_peered":"2024-04-01T15:21:59.697039+0000","last_clean":"2024-04-01T15:21:59.697039+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:21:59.697039+0000","last_undegraded":"2024-04-01T15:21:59.697039+0000","last_fullsized":"2024-04-01T15:21:59.697039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795333+0000","last_change":"2024-04-01T15:21:58.529847+0000","last_active":"2024-04-01T15:22:00.795333+0000","last_peered":"2024-04-01T15:22:00.795333+0000","last_clean":"2024-04-01T15:22:00.795333+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:22:00.795333+0000","last_undegraded":"2024-04-01T15:22:00.795333+0000","last_fullsized":"2024-04-01T15:22:00.795333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:44:07.006946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524893+0000","last_change":"2024-04-01T15:21:58.535414+0000","last_active":"2024-04-01T15:21:59.524893+0000","last_peered":"2024-04-01T15:21:59.524893+0000","last_clean":"2024-04-01T15:21:59.524893+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:21:59.524893+0000","last_undegraded":"2024-04-01T15:21:59.524893+0000","last_fullsized":"2024-04-01T15:21:59.524893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528323+0000","last_change":"2024-04-01T15:21:58.522234+0000","last_active":"2024-04-01T15:21:59.528323+0000","last_peered":"2024-04-01T15:21:59.528323+0000","last_clean":"2024-04-01T15:21:59.528323+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:21:59.528323+0000","last_undegraded":"2024-04-01T15:21:59.528323+0000","last_fullsized":"2024-04-01T15:21:59.528323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.530918+0000","last_change":"2024-04-01T15:21:58.531397+0000","last_active":"2024-04-01T15:21:59.530918+0000","last_peered":"2024-04-01T15:21:59.530918+0000","last_clean":"2024-04-01T15:21:59.530918+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:21:59.530918+0000","last_undegraded":"2024-04-01T15:21:59.530918+0000","last_fullsized":"2024-04-01T15:21:59.530918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.040302+0000","last_change":"2024-04-01T15:21:58.522828+0000","last_active":"2024-04-01T15:22:00.040302+0000","last_peered":"2024-04-01T15:22:00.040302+0000","last_clean":"2024-04-01T15:22:00.040302+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:22:00.040302+0000","last_undegraded":"2024-04-01T15:22:00.040302+0000","last_fullsized":"2024-04-01T15:22:00.040302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373931+0000","last_change":"2024-04-01T15:21:58.532575+0000","last_active":"2024-04-01T15:22:00.373931+0000","last_peered":"2024-04-01T15:22:00.373931+0000","last_clean":"2024-04-01T15:22:00.373931+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:22:00.373931+0000","last_undegraded":"2024-04-01T15:22:00.373931+0000","last_fullsized":"2024-04-01T15:22:00.373931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174864+0000","last_change":"2024-04-01T15:21:58.530543+0000","last_active":"2024-04-01T15:22:00.174864+0000","last_peered":"2024-04-01T15:22:00.174864+0000","last_clean":"2024-04-01T15:22:00.174864+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:22:00.174864+0000","last_undegraded":"2024-04-01T15:22:00.174864+0000","last_fullsized":"2024-04-01T15:22:00.174864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795532+0000","last_change":"2024-04-01T15:21:58.528377+0000","last_active":"2024-04-01T15:22:00.795532+0000","last_peered":"2024-04-01T15:22:00.795532+0000","last_clean":"2024-04-01T15:22:00.795532+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:22:00.795532+0000","last_undegraded":"2024-04-01T15:22:00.795532+0000","last_fullsized":"2024-04-01T15:22:00.795532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:56:09.008728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528834+0000","last_change":"2024-04-01T15:21:58.530746+0000","last_active":"2024-04-01T15:21:59.528834+0000","last_peered":"2024-04-01T15:21:59.528834+0000","last_clean":"2024-04-01T15:21:59.528834+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:21:59.528834+0000","last_undegraded":"2024-04-01T15:21:59.528834+0000","last_fullsized":"2024-04-01T15:21:59.528834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696730+0000","last_change":"2024-04-01T15:21:58.516408+0000","last_active":"2024-04-01T15:21:59.696730+0000","last_peered":"2024-04-01T15:21:59.696730+0000","last_clean":"2024-04-01T15:21:59.696730+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:21:59.696730+0000","last_undegraded":"2024-04-01T15:21:59.696730+0000","last_fullsized":"2024-04-01T15:21:59.696730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528199+0000","last_change":"2024-04-01T15:21:58.525868+0000","last_active":"2024-04-01T15:21:59.528199+0000","last_peered":"2024-04-01T15:21:59.528199+0000","last_clean":"2024-04-01T15:21:59.528199+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:21:59.528199+0000","last_undegraded":"2024-04-01T15:21:59.528199+0000","last_fullsized":"2024-04-01T15:21:59.528199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697382+0000","last_change":"2024-04-01T15:21:58.531952+0000","last_active":"2024-04-01T15:21:59.697382+0000","last_peered":"2024-04-01T15:21:59.697382+0000","last_clean":"2024-04-01T15:21:59.697382+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:21:59.697382+0000","last_undegraded":"2024-04-01T15:21:59.697382+0000","last_fullsized":"2024-04-01T15:21:59.697382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175425+0000","last_change":"2024-04-01T15:21:58.517341+0000","last_active":"2024-04-01T15:22:00.175425+0000","last_peered":"2024-04-01T15:22:00.175425+0000","last_clean":"2024-04-01T15:22:00.175425+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:22:00.175425+0000","last_undegraded":"2024-04-01T15:22:00.175425+0000","last_fullsized":"2024-04-01T15:22:00.175425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525136+0000","last_change":"2024-04-01T15:21:58.535087+0000","last_active":"2024-04-01T15:21:59.525136+0000","last_peered":"2024-04-01T15:21:59.525136+0000","last_clean":"2024-04-01T15:21:59.525136+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:21:59.525136+0000","last_undegraded":"2024-04-01T15:21:59.525136+0000","last_fullsized":"2024-04-01T15:21:59.525136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697491+0000","last_change":"2024-04-01T15:21:58.531487+0000","last_active":"2024-04-01T15:21:59.697491+0000","last_peered":"2024-04-01T15:21:59.697491+0000","last_clean":"2024-04-01T15:21:59.697491+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:21:59.697491+0000","last_undegraded":"2024-04-01T15:21:59.697491+0000","last_fullsized":"2024-04-01T15:21:59.697491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795574+0000","last_change":"2024-04-01T15:21:58.531305+0000","last_active":"2024-04-01T15:22:00.795574+0000","last_peered":"2024-04-01T15:22:00.795574+0000","last_clean":"2024-04-01T15:22:00.795574+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:22:00.795574+0000","last_undegraded":"2024-04-01T15:22:00.795574+0000","last_fullsized":"2024-04-01T15:22:00.795574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528885+0000","last_change":"2024-04-01T15:21:58.530998+0000","last_active":"2024-04-01T15:21:59.528885+0000","last_peered":"2024-04-01T15:21:59.528885+0000","last_clean":"2024-04-01T15:21:59.528885+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:21:59.528885+0000","last_undegraded":"2024-04-01T15:21:59.528885+0000","last_fullsized":"2024-04-01T15:21:59.528885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039960+0000","last_change":"2024-04-01T15:21:58.523119+0000","last_active":"2024-04-01T15:22:00.039960+0000","last_peered":"2024-04-01T15:22:00.039960+0000","last_clean":"2024-04-01T15:22:00.039960+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:22:00.039960+0000","last_undegraded":"2024-04-01T15:22:00.039960+0000","last_fullsized":"2024-04-01T15:22:00.039960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174268+0000","last_change":"2024-04-01T15:21:58.514302+0000","last_active":"2024-04-01T15:22:00.174268+0000","last_peered":"2024-04-01T15:22:00.174268+0000","last_clean":"2024-04-01T15:22:00.174268+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:22:00.174268+0000","last_undegraded":"2024-04-01T15:22:00.174268+0000","last_fullsized":"2024-04-01T15:22:00.174268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524902+0000","last_change":"2024-04-01T15:21:58.528525+0000","last_active":"2024-04-01T15:21:59.524902+0000","last_peered":"2024-04-01T15:21:59.524902+0000","last_clean":"2024-04-01T15:21:59.524902+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:21:59.524902+0000","last_undegraded":"2024-04-01T15:21:59.524902+0000","last_fullsized":"2024-04-01T15:21:59.524902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:58.054203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697111+0000","last_change":"2024-04-01T15:21:57.523557+0000","last_active":"2024-04-01T15:21:59.697111+0000","last_peered":"2024-04-01T15:21:59.697111+0000","last_clean":"2024-04-01T15:21:59.697111+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:21:59.697111+0000","last_undegraded":"2024-04-01T15:21:59.697111+0000","last_fullsized":"2024-04-01T15:21:59.697111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795700+0000","last_change":"2024-04-01T15:21:58.531570+0000","last_active":"2024-04-01T15:22:00.795700+0000","last_peered":"2024-04-01T15:22:00.795700+0000","last_clean":"2024-04-01T15:22:00.795700+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:22:00.795700+0000","last_undegraded":"2024-04-01T15:22:00.795700+0000","last_fullsized":"2024-04-01T15:22:00.795700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174511+0000","last_change":"2024-04-01T15:21:57.519248+0000","last_active":"2024-04-01T15:22:00.174511+0000","last_peered":"2024-04-01T15:22:00.174511+0000","last_clean":"2024-04-01T15:22:00.174511+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:22:00.174511+0000","last_undegraded":"2024-04-01T15:22:00.174511+0000","last_fullsized":"2024-04-01T15:22:00.174511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696520+0000","last_change":"2024-04-01T15:21:57.518727+0000","last_active":"2024-04-01T15:21:59.696520+0000","last_peered":"2024-04-01T15:21:59.696520+0000","last_clean":"2024-04-01T15:21:59.696520+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:21:59.696520+0000","last_undegraded":"2024-04-01T15:21:59.696520+0000","last_fullsized":"2024-04-01T15:21:59.696520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:15:36.993209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696524+0000","last_change":"2024-04-01T15:21:58.527894+0000","last_active":"2024-04-01T15:21:59.696524+0000","last_peered":"2024-04-01T15:21:59.696524+0000","last_clean":"2024-04-01T15:21:59.696524+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:21:59.696524+0000","last_undegraded":"2024-04-01T15:21:59.696524+0000","last_fullsized":"2024-04-01T15:21:59.696524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528268+0000","last_change":"2024-04-01T15:21:57.534982+0000","last_active":"2024-04-01T15:21:59.528268+0000","last_peered":"2024-04-01T15:21:59.528268+0000","last_clean":"2024-04-01T15:21:59.528268+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:21:59.528268+0000","last_undegraded":"2024-04-01T15:21:59.528268+0000","last_fullsized":"2024-04-01T15:21:59.528268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524398+0000","last_change":"2024-04-01T15:21:58.525017+0000","last_active":"2024-04-01T15:21:59.524398+0000","last_peered":"2024-04-01T15:21:59.524398+0000","last_clean":"2024-04-01T15:21:59.524398+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:21:59.524398+0000","last_undegraded":"2024-04-01T15:21:59.524398+0000","last_fullsized":"2024-04-01T15:21:59.524398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175037+0000","last_change":"2024-04-01T15:21:57.528840+0000","last_active":"2024-04-01T15:22:00.175037+0000","last_peered":"2024-04-01T15:22:00.175037+0000","last_clean":"2024-04-01T15:22:00.175037+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:22:00.175037+0000","last_undegraded":"2024-04-01T15:22:00.175037+0000","last_fullsized":"2024-04-01T15:22:00.175037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529666+0000","last_change":"2024-04-01T15:21:58.529422+0000","last_active":"2024-04-01T15:21:59.529666+0000","last_peered":"2024-04-01T15:21:59.529666+0000","last_clean":"2024-04-01T15:21:59.529666+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:21:59.529666+0000","last_undegraded":"2024-04-01T15:21:59.529666+0000","last_fullsized":"2024-04-01T15:21:59.529666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529803+0000","last_change":"2024-04-01T15:21:57.528345+0000","last_active":"2024-04-01T15:21:59.529803+0000","last_peered":"2024-04-01T15:21:59.529803+0000","last_clean":"2024-04-01T15:21:59.529803+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:21:59.529803+0000","last_undegraded":"2024-04-01T15:21:59.529803+0000","last_fullsized":"2024-04-01T15:21:59.529803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795783+0000","last_change":"2024-04-01T15:21:58.529376+0000","last_active":"2024-04-01T15:22:00.795783+0000","last_peered":"2024-04-01T15:22:00.795783+0000","last_clean":"2024-04-01T15:22:00.795783+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:22:00.795783+0000","last_undegraded":"2024-04-01T15:22:00.795783+0000","last_fullsized":"2024-04-01T15:22:00.795783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524861+0000","last_change":"2024-04-01T15:21:57.526610+0000","last_active":"2024-04-01T15:21:59.524861+0000","last_peered":"2024-04-01T15:21:59.524861+0000","last_clean":"2024-04-01T15:21:59.524861+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:21:59.524861+0000","last_undegraded":"2024-04-01T15:21:59.524861+0000","last_fullsized":"2024-04-01T15:21:59.524861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525355+0000","last_change":"2024-04-01T15:21:58.537476+0000","last_active":"2024-04-01T15:21:59.525355+0000","last_peered":"2024-04-01T15:21:59.525355+0000","last_clean":"2024-04-01T15:21:59.525355+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:21:59.525355+0000","last_undegraded":"2024-04-01T15:21:59.525355+0000","last_fullsized":"2024-04-01T15:21:59.525355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174501+0000","last_change":"2024-04-01T15:21:57.513766+0000","last_active":"2024-04-01T15:22:00.174501+0000","last_peered":"2024-04-01T15:22:00.174501+0000","last_clean":"2024-04-01T15:22:00.174501+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:22:00.174501+0000","last_undegraded":"2024-04-01T15:22:00.174501+0000","last_fullsized":"2024-04-01T15:22:00.174501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373572+0000","last_change":"2024-04-01T15:21:58.539751+0000","last_active":"2024-04-01T15:22:00.373572+0000","last_peered":"2024-04-01T15:22:00.373572+0000","last_clean":"2024-04-01T15:22:00.373572+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:22:00.373572+0000","last_undegraded":"2024-04-01T15:22:00.373572+0000","last_fullsized":"2024-04-01T15:22:00.373572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795635+0000","last_change":"2024-04-01T15:21:57.520158+0000","last_active":"2024-04-01T15:22:00.795635+0000","last_peered":"2024-04-01T15:22:00.795635+0000","last_clean":"2024-04-01T15:22:00.795635+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:22:00.795635+0000","last_undegraded":"2024-04-01T15:22:00.795635+0000","last_fullsized":"2024-04-01T15:22:00.795635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795381+0000","last_change":"2024-04-01T15:21:58.532249+0000","last_active":"2024-04-01T15:22:00.795381+0000","last_peered":"2024-04-01T15:22:00.795381+0000","last_clean":"2024-04-01T15:22:00.795381+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:22:00.795381+0000","last_undegraded":"2024-04-01T15:22:00.795381+0000","last_fullsized":"2024-04-01T15:22:00.795381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.229948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529411+0000","last_change":"2024-04-01T15:21:57.528780+0000","last_active":"2024-04-01T15:21:59.529411+0000","last_peered":"2024-04-01T15:21:59.529411+0000","last_clean":"2024-04-01T15:21:59.529411+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:21:59.529411+0000","last_undegraded":"2024-04-01T15:21:59.529411+0000","last_fullsized":"2024-04-01T15:21:59.529411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374292+0000","last_change":"2024-04-01T15:21:58.528458+0000","last_active":"2024-04-01T15:22:00.374292+0000","last_peered":"2024-04-01T15:22:00.374292+0000","last_clean":"2024-04-01T15:22:00.374292+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:22:00.374292+0000","last_undegraded":"2024-04-01T15:22:00.374292+0000","last_fullsized":"2024-04-01T15:22:00.374292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174063+0000","last_change":"2024-04-01T15:21:57.528026+0000","last_active":"2024-04-01T15:22:00.174063+0000","last_peered":"2024-04-01T15:22:00.174063+0000","last_clean":"2024-04-01T15:22:00.174063+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:22:00.174063+0000","last_undegraded":"2024-04-01T15:22:00.174063+0000","last_fullsized":"2024-04-01T15:22:00.174063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174372+0000","last_change":"2024-04-01T15:21:58.514047+0000","last_active":"2024-04-01T15:22:00.174372+0000","last_peered":"2024-04-01T15:22:00.174372+0000","last_clean":"2024-04-01T15:22:00.174372+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:22:00.174372+0000","last_undegraded":"2024-04-01T15:22:00.174372+0000","last_fullsized":"2024-04-01T15:22:00.174372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039609+0000","last_change":"2024-04-01T15:21:57.517184+0000","last_active":"2024-04-01T15:22:00.039609+0000","last_peered":"2024-04-01T15:22:00.039609+0000","last_clean":"2024-04-01T15:22:00.039609+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:22:00.039609+0000","last_undegraded":"2024-04-01T15:22:00.039609+0000","last_fullsized":"2024-04-01T15:22:00.039609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374874+0000","last_change":"2024-04-01T15:21:58.529946+0000","last_active":"2024-04-01T15:22:00.374874+0000","last_peered":"2024-04-01T15:22:00.374874+0000","last_clean":"2024-04-01T15:22:00.374874+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:22:00.374874+0000","last_undegraded":"2024-04-01T15:22:00.374874+0000","last_fullsized":"2024-04-01T15:22:00.374874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525712+0000","last_change":"2024-04-01T15:21:57.519642+0000","last_active":"2024-04-01T15:21:59.525712+0000","last_peered":"2024-04-01T15:21:59.525712+0000","last_clean":"2024-04-01T15:21:59.525712+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:21:59.525712+0000","last_undegraded":"2024-04-01T15:21:59.525712+0000","last_fullsized":"2024-04-01T15:21:59.525712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:09:07.894019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374100+0000","last_change":"2024-04-01T15:21:58.529121+0000","last_active":"2024-04-01T15:22:00.374100+0000","last_peered":"2024-04-01T15:22:00.374100+0000","last_clean":"2024-04-01T15:22:00.374100+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:22:00.374100+0000","last_undegraded":"2024-04-01T15:22:00.374100+0000","last_fullsized":"2024-04-01T15:22:00.374100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039988+0000","last_change":"2024-04-01T15:21:57.514455+0000","last_active":"2024-04-01T15:22:00.039988+0000","last_peered":"2024-04-01T15:22:00.039988+0000","last_clean":"2024-04-01T15:22:00.039988+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:22:00.039988+0000","last_undegraded":"2024-04-01T15:22:00.039988+0000","last_fullsized":"2024-04-01T15:22:00.039988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374717+0000","last_change":"2024-04-01T15:21:58.535610+0000","last_active":"2024-04-01T15:22:00.374717+0000","last_peered":"2024-04-01T15:22:00.374717+0000","last_clean":"2024-04-01T15:22:00.374717+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:22:00.374717+0000","last_undegraded":"2024-04-01T15:22:00.374717+0000","last_fullsized":"2024-04-01T15:22:00.374717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524990+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:21:59.524990+0000","last_peered":"2024-04-01T15:21:59.524990+0000","last_clean":"2024-04-01T15:21:59.524990+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:21:59.524990+0000","last_undegraded":"2024-04-01T15:21:59.524990+0000","last_fullsized":"2024-04-01T15:21:59.524990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529157+0000","last_change":"2024-04-01T15:21:58.533365+0000","last_active":"2024-04-01T15:21:59.529157+0000","last_peered":"2024-04-01T15:21:59.529157+0000","last_clean":"2024-04-01T15:21:59.529157+0000","last_became_active":"2024-04-01T15:21:58.533141+0000","last_became_peered":"2024-04-01T15:21:58.533141+0000","last_unstale":"2024-04-01T15:21:59.529157+0000","last_undegraded":"2024-04-01T15:21:59.529157+0000","last_fullsized":"2024-04-01T15:21:59.529157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039888+0000","last_change":"2024-04-01T15:21:57.532167+0000","last_active":"2024-04-01T15:22:00.039888+0000","last_peered":"2024-04-01T15:22:00.039888+0000","last_clean":"2024-04-01T15:22:00.039888+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:22:00.039888+0000","last_undegraded":"2024-04-01T15:22:00.039888+0000","last_fullsized":"2024-04-01T15:22:00.039888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373757+0000","last_change":"2024-04-01T15:21:58.530108+0000","last_active":"2024-04-01T15:22:00.373757+0000","last_peered":"2024-04-01T15:22:00.373757+0000","last_clean":"2024-04-01T15:22:00.373757+0000","last_became_active":"2024-04-01T15:21:58.529794+0000","last_became_peered":"2024-04-01T15:21:58.529794+0000","last_unstale":"2024-04-01T15:22:00.373757+0000","last_undegraded":"2024-04-01T15:22:00.373757+0000","last_fullsized":"2024-04-01T15:22:00.373757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373799+0000","last_change":"2024-04-01T15:21:47.878530+0000","last_active":"2024-04-01T15:22:00.373799+0000","last_peered":"2024-04-01T15:22:00.373799+0000","last_clean":"2024-04-01T15:22:00.373799+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:22:00.373799+0000","last_undegraded":"2024-04-01T15:22:00.373799+0000","last_fullsized":"2024-04-01T15:22:00.373799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_clean_scrub_stamp":"2024-04-01T15:21:46.852307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:25:18.137507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528321+0000","last_change":"2024-04-01T15:21:57.530394+0000","last_active":"2024-04-01T15:21:59.528321+0000","last_peered":"2024-04-01T15:21:59.528321+0000","last_clean":"2024-04-01T15:21:59.528321+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:21:59.528321+0000","last_undegraded":"2024-04-01T15:21:59.528321+0000","last_fullsized":"2024-04-01T15:21:59.528321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697106+0000","last_change":"2024-04-01T15:21:58.529751+0000","last_active":"2024-04-01T15:21:59.697106+0000","last_peered":"2024-04-01T15:21:59.697106+0000","last_clean":"2024-04-01T15:21:59.697106+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:21:59.697106+0000","last_undegraded":"2024-04-01T15:21:59.697106+0000","last_fullsized":"2024-04-01T15:21:59.697106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373518+0000","last_change":"2024-04-01T15:21:57.526919+0000","last_active":"2024-04-01T15:22:00.373518+0000","last_peered":"2024-04-01T15:22:00.373518+0000","last_clean":"2024-04-01T15:22:00.373518+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:22:00.373518+0000","last_undegraded":"2024-04-01T15:22:00.373518+0000","last_fullsized":"2024-04-01T15:22:00.373518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.796128+0000","last_change":"2024-04-01T15:21:58.525329+0000","last_active":"2024-04-01T15:22:00.796128+0000","last_peered":"2024-04-01T15:22:00.796128+0000","last_clean":"2024-04-01T15:22:00.796128+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:22:00.796128+0000","last_undegraded":"2024-04-01T15:22:00.796128+0000","last_fullsized":"2024-04-01T15:22:00.796128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.040177+0000","last_change":"2024-04-01T15:21:57.511176+0000","last_active":"2024-04-01T15:22:00.040177+0000","last_peered":"2024-04-01T15:22:00.040177+0000","last_clean":"2024-04-01T15:22:00.040177+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:22:00.040177+0000","last_undegraded":"2024-04-01T15:22:00.040177+0000","last_fullsized":"2024-04-01T15:22:00.040177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524559+0000","last_change":"2024-04-01T15:21:58.523794+0000","last_active":"2024-04-01T15:21:59.524559+0000","last_peered":"2024-04-01T15:21:59.524559+0000","last_clean":"2024-04-01T15:21:59.524559+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:21:59.524559+0000","last_undegraded":"2024-04-01T15:21:59.524559+0000","last_fullsized":"2024-04-01T15:21:59.524559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529840+0000","last_change":"2024-04-01T15:21:57.527763+0000","last_active":"2024-04-01T15:21:59.529840+0000","last_peered":"2024-04-01T15:21:59.529840+0000","last_clean":"2024-04-01T15:21:59.529840+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:21:59.529840+0000","last_undegraded":"2024-04-01T15:21:59.529840+0000","last_fullsized":"2024-04-01T15:21:59.529840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524921+0000","last_change":"2024-04-01T15:21:58.531026+0000","last_active":"2024-04-01T15:21:59.524921+0000","last_peered":"2024-04-01T15:21:59.524921+0000","last_clean":"2024-04-01T15:21:59.524921+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:21:59.524921+0000","last_undegraded":"2024-04-01T15:21:59.524921+0000","last_fullsized":"2024-04-01T15:21:59.524921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:50.706762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524830+0000","last_change":"2024-04-01T15:21:57.517159+0000","last_active":"2024-04-01T15:21:59.524830+0000","last_peered":"2024-04-01T15:21:59.524830+0000","last_clean":"2024-04-01T15:21:59.524830+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:21:59.524830+0000","last_undegraded":"2024-04-01T15:21:59.524830+0000","last_fullsized":"2024-04-01T15:21:59.524830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529965+0000","last_change":"2024-04-01T15:21:58.541348+0000","last_active":"2024-04-01T15:21:59.529965+0000","last_peered":"2024-04-01T15:21:59.529965+0000","last_clean":"2024-04-01T15:21:59.529965+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:21:59.529965+0000","last_undegraded":"2024-04-01T15:21:59.529965+0000","last_fullsized":"2024-04-01T15:21:59.529965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373995+0000","last_change":"2024-04-01T15:21:57.526914+0000","last_active":"2024-04-01T15:22:00.373995+0000","last_peered":"2024-04-01T15:22:00.373995+0000","last_clean":"2024-04-01T15:22:00.373995+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:22:00.373995+0000","last_undegraded":"2024-04-01T15:22:00.373995+0000","last_fullsized":"2024-04-01T15:22:00.373995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524661+0000","last_change":"2024-04-01T15:21:58.515834+0000","last_active":"2024-04-01T15:21:59.524661+0000","last_peered":"2024-04-01T15:21:59.524661+0000","last_clean":"2024-04-01T15:21:59.524661+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:21:59.524661+0000","last_undegraded":"2024-04-01T15:21:59.524661+0000","last_fullsized":"2024-04-01T15:21:59.524661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525272+0000","last_change":"2024-04-01T15:21:57.533452+0000","last_active":"2024-04-01T15:21:59.525272+0000","last_peered":"2024-04-01T15:21:59.525272+0000","last_clean":"2024-04-01T15:21:59.525272+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:21:59.525272+0000","last_undegraded":"2024-04-01T15:21:59.525272+0000","last_fullsized":"2024-04-01T15:21:59.525272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697608+0000","last_change":"2024-04-01T15:21:58.512191+0000","last_active":"2024-04-01T15:21:59.697608+0000","last_peered":"2024-04-01T15:21:59.697608+0000","last_clean":"2024-04-01T15:21:59.697608+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:21:59.697608+0000","last_undegraded":"2024-04-01T15:21:59.697608+0000","last_fullsized":"2024-04-01T15:21:59.697608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175206+0000","last_change":"2024-04-01T15:21:57.526196+0000","last_active":"2024-04-01T15:22:00.175206+0000","last_peered":"2024-04-01T15:22:00.175206+0000","last_clean":"2024-04-01T15:22:00.175206+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:22:00.175206+0000","last_undegraded":"2024-04-01T15:22:00.175206+0000","last_fullsized":"2024-04-01T15:22:00.175206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795819+0000","last_change":"2024-04-01T15:21:58.526739+0000","last_active":"2024-04-01T15:22:00.795819+0000","last_peered":"2024-04-01T15:22:00.795819+0000","last_clean":"2024-04-01T15:22:00.795819+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:22:00.795819+0000","last_undegraded":"2024-04-01T15:22:00.795819+0000","last_fullsized":"2024-04-01T15:22:00.795819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373249+0000","last_change":"2024-04-01T15:21:57.526924+0000","last_active":"2024-04-01T15:22:00.373249+0000","last_peered":"2024-04-01T15:22:00.373249+0000","last_clean":"2024-04-01T15:22:00.373249+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:22:00.373249+0000","last_undegraded":"2024-04-01T15:22:00.373249+0000","last_fullsized":"2024-04-01T15:22:00.373249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524505+0000","last_change":"2024-04-01T15:21:58.528396+0000","last_active":"2024-04-01T15:21:59.524505+0000","last_peered":"2024-04-01T15:21:59.524505+0000","last_clean":"2024-04-01T15:21:59.524505+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:21:59.524505+0000","last_undegraded":"2024-04-01T15:21:59.524505+0000","last_fullsized":"2024-04-01T15:21:59.524505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:50.943225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525048+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:21:59.525048+0000","last_peered":"2024-04-01T15:21:59.525048+0000","last_clean":"2024-04-01T15:21:59.525048+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:21:59.525048+0000","last_undegraded":"2024-04-01T15:21:59.525048+0000","last_fullsized":"2024-04-01T15:21:59.525048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:09.572891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696891+0000","last_change":"2024-04-01T15:21:58.529955+0000","last_active":"2024-04-01T15:21:59.696891+0000","last_peered":"2024-04-01T15:21:59.696891+0000","last_clean":"2024-04-01T15:21:59.696891+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:21:59.696891+0000","last_undegraded":"2024-04-01T15:21:59.696891+0000","last_fullsized":"2024-04-01T15:21:59.696891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524416+0000","last_change":"2024-04-01T15:21:57.526620+0000","last_active":"2024-04-01T15:21:59.524416+0000","last_peered":"2024-04-01T15:21:59.524416+0000","last_clean":"2024-04-01T15:21:59.524416+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:21:59.524416+0000","last_undegraded":"2024-04-01T15:21:59.524416+0000","last_fullsized":"2024-04-01T15:21:59.524416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697310+0000","last_change":"2024-04-01T15:21:58.534484+0000","last_active":"2024-04-01T15:21:59.697310+0000","last_peered":"2024-04-01T15:21:59.697310+0000","last_clean":"2024-04-01T15:21:59.697310+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:21:59.697310+0000","last_undegraded":"2024-04-01T15:21:59.697310+0000","last_fullsized":"2024-04-01T15:21:59.697310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374424+0000","last_change":"2024-04-01T15:21:57.531639+0000","last_active":"2024-04-01T15:22:00.374424+0000","last_peered":"2024-04-01T15:22:00.374424+0000","last_clean":"2024-04-01T15:22:00.374424+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:22:00.374424+0000","last_undegraded":"2024-04-01T15:22:00.374424+0000","last_fullsized":"2024-04-01T15:22:00.374424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174380+0000","last_change":"2024-04-01T15:21:58.523366+0000","last_active":"2024-04-01T15:22:00.174380+0000","last_peered":"2024-04-01T15:22:00.174380+0000","last_clean":"2024-04-01T15:22:00.174380+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:22:00.174380+0000","last_undegraded":"2024-04-01T15:22:00.174380+0000","last_fullsized":"2024-04-01T15:22:00.174380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529585+0000","last_change":"2024-04-01T15:21:58.526457+0000","last_active":"2024-04-01T15:21:59.529585+0000","last_peered":"2024-04-01T15:21:59.529585+0000","last_clean":"2024-04-01T15:21:59.529585+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:21:59.529585+0000","last_undegraded":"2024-04-01T15:21:59.529585+0000","last_fullsized":"2024-04-01T15:21:59.529585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373310+0000","last_change":"2024-04-01T15:21:57.534510+0000","last_active":"2024-04-01T15:22:00.373310+0000","last_peered":"2024-04-01T15:22:00.373310+0000","last_clean":"2024-04-01T15:22:00.373310+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:22:00.373310+0000","last_undegraded":"2024-04-01T15:22:00.373310+0000","last_fullsized":"2024-04-01T15:22:00.373310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528978+0000","last_change":"2024-04-01T15:21:58.537101+0000","last_active":"2024-04-01T15:21:59.528978+0000","last_peered":"2024-04-01T15:21:59.528978+0000","last_clean":"2024-04-01T15:21:59.528978+0000","last_became_active":"2024-04-01T15:21:58.536776+0000","last_became_peered":"2024-04-01T15:21:58.536776+0000","last_unstale":"2024-04-01T15:21:59.528978+0000","last_undegraded":"2024-04-01T15:21:59.528978+0000","last_fullsized":"2024-04-01T15:21:59.528978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373757+0000","last_change":"2024-04-01T15:21:57.533797+0000","last_active":"2024-04-01T15:22:00.373757+0000","last_peered":"2024-04-01T15:22:00.373757+0000","last_clean":"2024-04-01T15:22:00.373757+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:22:00.373757+0000","last_undegraded":"2024-04-01T15:22:00.373757+0000","last_fullsized":"2024-04-01T15:22:00.373757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:16:16.205030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795639+0000","last_change":"2024-04-01T15:21:58.524922+0000","last_active":"2024-04-01T15:22:00.795639+0000","last_peered":"2024-04-01T15:22:00.795639+0000","last_clean":"2024-04-01T15:22:00.795639+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:22:00.795639+0000","last_undegraded":"2024-04-01T15:22:00.795639+0000","last_fullsized":"2024-04-01T15:22:00.795639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697725+0000","last_change":"2024-04-01T15:21:57.518934+0000","last_active":"2024-04-01T15:21:59.697725+0000","last_peered":"2024-04-01T15:21:59.697725+0000","last_clean":"2024-04-01T15:21:59.697725+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:21:59.697725+0000","last_undegraded":"2024-04-01T15:21:59.697725+0000","last_fullsized":"2024-04-01T15:21:59.697725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697866+0000","last_change":"2024-04-01T15:21:58.538259+0000","last_active":"2024-04-01T15:21:59.697866+0000","last_peered":"2024-04-01T15:21:59.697866+0000","last_clean":"2024-04-01T15:21:59.697866+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:21:59.697866+0000","last_undegraded":"2024-04-01T15:21:59.697866+0000","last_fullsized":"2024-04-01T15:21:59.697866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795827+0000","last_change":"2024-04-01T15:21:57.524507+0000","last_active":"2024-04-01T15:22:00.795827+0000","last_peered":"2024-04-01T15:22:00.795827+0000","last_clean":"2024-04-01T15:22:00.795827+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:22:00.795827+0000","last_undegraded":"2024-04-01T15:22:00.795827+0000","last_fullsized":"2024-04-01T15:22:00.795827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:29:44.659776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:22:02.962 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:22:03.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.209+0000 7f6d55600640 1 Processor -- start 2024-04-01T15:22:03.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.209+0000 7f6d55600640 1 -- start start 2024-04-01T15:22:03.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.210+0000 7f6d55600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d500b51c0 0x7f6d5014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.210+0000 7f6d55600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500afae0 0x7f6d500aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.210+0000 7f6d55600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d500b1b90 0x7f6d500b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.210+0000 7f6d55600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6d500b55a0 con 0x7f6d500b51c0 2024-04-01T15:22:03.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.210+0000 7f6d55600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f6d500b0430 con 0x7f6d500b1b90 2024-04-01T15:22:03.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.210+0000 7f6d55600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6d500ae8c0 con 0x7f6d500afae0 2024-04-01T15:22:03.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4ea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d500b51c0 0x7f6d5014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4ea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d500b51c0 0x7f6d5014ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59914/0 (socket says 172.21.15.142:59914) 2024-04-01T15:22:03.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4ea00640 1 -- 172.21.15.142:0/2682592424 learned_addr learned my addr 172.21.15.142:0/2682592424 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:03.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4e000640 1 --2- 172.21.15.142:0/2682592424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500afae0 0x7f6d500aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4f400640 1 --2- 172.21.15.142:0/2682592424 >> v2:172.21.15.179:3300/0 conn(0x7f6d500b1b90 0x7f6d500b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4ea00640 1 -- 172.21.15.142:0/2682592424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500afae0 msgr2=0x7f6d500aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:03.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4ea00640 1 --2- 172.21.15.142:0/2682592424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500afae0 0x7f6d500aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4ea00640 1 -- 172.21.15.142:0/2682592424 >> v2:172.21.15.179:3300/0 conn(0x7f6d500b1b90 msgr2=0x7f6d500b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:03.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4ea00640 1 --2- 172.21.15.142:0/2682592424 >> v2:172.21.15.179:3300/0 conn(0x7f6d500b1b90 0x7f6d500b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.211+0000 7f6d4ea00640 1 -- 172.21.15.142:0/2682592424 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5006db20 con 0x7f6d500b51c0 2024-04-01T15:22:03.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.213+0000 7f6d4ea00640 1 --2- 172.21.15.142:0/2682592424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 0x7f6d5014ae90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d5006be60 tx=0x7f6d4002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10862e3a70719f03 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.213+0000 7f6d4d600640 1 -- 172.21.15.142:0/2682592424 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40038070 con 0x7f6d500b51c0 2024-04-01T15:22:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.213+0000 7f6d4d600640 1 -- 172.21.15.142:0/2682592424 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4002f050 con 0x7f6d500b51c0 2024-04-01T15:22:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.213+0000 7f6d4d600640 1 -- 172.21.15.142:0/2682592424 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40031970 con 0x7f6d500b51c0 2024-04-01T15:22:03.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.214+0000 7f6d55600640 1 -- 172.21.15.142:0/2682592424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 msgr2=0x7f6d5014ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.214+0000 7f6d55600640 1 --2- 172.21.15.142:0/2682592424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 0x7f6d5014ae90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d5006be60 tx=0x7f6d4002b7f0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.214+0000 7f6d55600640 1 -- 172.21.15.142:0/2682592424 shutdown_connections 2024-04-01T15:22:03.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.214+0000 7f6d55600640 1 --2- 172.21.15.142:0/2682592424 >> v2:172.21.15.179:3300/0 conn(0x7f6d500b1b90 0x7f6d500b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.214+0000 7f6d55600640 1 --2- 172.21.15.142:0/2682592424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500afae0 0x7f6d500aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.214+0000 7f6d55600640 1 --2- 172.21.15.142:0/2682592424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 0x7f6d5014ae90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.214+0000 7f6d55600640 1 -- 172.21.15.142:0/2682592424 >> 172.21.15.142:0/2682592424 conn(0x7f6d500b5890 msgr2=0x7f6d500b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:03.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.214+0000 7f6d55600640 1 -- 172.21.15.142:0/2682592424 shutdown_connections 2024-04-01T15:22:03.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.214+0000 7f6d55600640 1 -- 172.21.15.142:0/2682592424 wait complete. 2024-04-01T15:22:03.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.216+0000 7f6d55600640 1 Processor -- start 2024-04-01T15:22:03.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.216+0000 7f6d55600640 1 -- start start 2024-04-01T15:22:03.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d55600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500b1b90 0x7f6d50143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d55600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 0x7f6d501d1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d55600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d501d3570 0x7f6d501d1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d55600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6d500adf30 con 0x7f6d500b51c0 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d55600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d500addb0 con 0x7f6d501d3570 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d55600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6d500ae170 con 0x7f6d500b1b90 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 0x7f6d501d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 0x7f6d501d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59922/0 (socket says 172.21.15.142:59922) 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4e000640 1 -- 172.21.15.142:0/1213839214 learned_addr learned my addr 172.21.15.142:0/1213839214 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4ea00640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500b1b90 0x7f6d50143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4f400640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d501d3570 0x7f6d501d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4e000640 1 -- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500b1b90 msgr2=0x7f6d50143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4e000640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500b1b90 0x7f6d50143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4e000640 1 -- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d501d3570 msgr2=0x7f6d501d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4e000640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d501d3570 0x7f6d501d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.217+0000 7f6d4e000640 1 -- 172.21.15.142:0/1213839214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5014a5e0 con 0x7f6d500b51c0 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.218+0000 7f6d4e000640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 0x7f6d501d1040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d830 tx=0x7f6d3c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.218+0000 7f6d46a00640 1 -- 172.21.15.142:0/1213839214 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c007e10 con 0x7f6d500b51c0 2024-04-01T15:22:03.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.218+0000 7f6d46a00640 1 -- 172.21.15.142:0/1213839214 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c019070 con 0x7f6d500b51c0 2024-04-01T15:22:03.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.218+0000 7f6d46a00640 1 -- 172.21.15.142:0/1213839214 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00bb10 con 0x7f6d500b51c0 2024-04-01T15:22:03.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.218+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5014a8c0 con 0x7f6d500b51c0 2024-04-01T15:22:03.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.218+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d50143ed0 con 0x7f6d500b51c0 2024-04-01T15:22:03.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.219+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d50068710 con 0x7f6d500b51c0 2024-04-01T15:22:03.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.220+0000 7f6d46a00640 1 -- 172.21.15.142:0/1213839214 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d3c00bcb0 con 0x7f6d500b51c0 2024-04-01T15:22:03.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.221+0000 7f6d46a00640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6d3006c8f0 0x7f6d3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.221+0000 7f6d46a00640 1 -- 172.21.15.142:0/1213839214 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6d3c08be20 con 0x7f6d500b51c0 2024-04-01T15:22:03.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.222+0000 7f6d4ea00640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6d3006c8f0 0x7f6d3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.223+0000 7f6d4ea00640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6d3006c8f0 0x7f6d3006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d40035000 tx=0x7f6d40008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.226+0000 7f6d46a00640 1 -- 172.21.15.142:0/1213839214 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6d3c023020 con 0x7f6d500b51c0 2024-04-01T15:22:03.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.421+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d500b88b0 con 0x7f6d3006c8f0 2024-04-01T15:22:03.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.442+0000 7f6d46a00640 1 -- 172.21.15.142:0/1213839214 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f6d500b88b0 con 0x7f6d3006c8f0 2024-04-01T15:22:03.447 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:03.449 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.447+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6d3006c8f0 msgr2=0x7f6d3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.447+0000 7f6d55600640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6d3006c8f0 0x7f6d3006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d40035000 tx=0x7f6d40008030 comp rx=0 tx=0).stop 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.447+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 msgr2=0x7f6d501d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.447+0000 7f6d55600640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 0x7f6d501d1040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d830 tx=0x7f6d3c00dcf0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.447+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 shutdown_connections 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.447+0000 7f6d55600640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6d3006c8f0 0x7f6d3006edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.447+0000 7f6d55600640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d501d3570 0x7f6d501d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.447+0000 7f6d55600640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d500b51c0 0x7f6d501d1040 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.448+0000 7f6d55600640 1 --2- 172.21.15.142:0/1213839214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d500b1b90 0x7f6d50143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.448+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 >> 172.21.15.142:0/1213839214 conn(0x7f6d500b5890 msgr2=0x7f6d5006c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.448+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 shutdown_connections 2024-04-01T15:22:03.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.448+0000 7f6d55600640 1 -- 172.21.15.142:0/1213839214 wait complete. 2024-04-01T15:22:03.468 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-01T15:22:02.557998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001978"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374534+0000","last_change":"2024-04-01T15:21:58.539004+0000","last_active":"2024-04-01T15:22:00.374534+0000","last_peered":"2024-04-01T15:22:00.374534+0000","last_clean":"2024-04-01T15:22:00.374534+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:22:00.374534+0000","last_undegraded":"2024-04-01T15:22:00.374534+0000","last_fullsized":"2024-04-01T15:22:00.374534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525492+0000","last_change":"2024-04-01T15:21:58.524238+0000","last_active":"2024-04-01T15:21:59.525492+0000","last_peered":"2024-04-01T15:21:59.525492+0000","last_clean":"2024-04-01T15:21:59.525492+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:21:59.525492+0000","last_undegraded":"2024-04-01T15:21:59.525492+0000","last_fullsized":"2024-04-01T15:21:59.525492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795772+0000","last_change":"2024-04-01T15:21:58.526226+0000","last_active":"2024-04-01T15:22:00.795772+0000","last_peered":"2024-04-01T15:22:00.795772+0000","last_clean":"2024-04-01T15:22:00.795772+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:22:00.795772+0000","last_undegraded":"2024-04-01T15:22:00.795772+0000","last_fullsized":"2024-04-01T15:22:00.795772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528754+0000","last_change":"2024-04-01T15:21:58.541297+0000","last_active":"2024-04-01T15:21:59.528754+0000","last_peered":"2024-04-01T15:21:59.528754+0000","last_clean":"2024-04-01T15:21:59.528754+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:21:59.528754+0000","last_undegraded":"2024-04-01T15:21:59.528754+0000","last_fullsized":"2024-04-01T15:21:59.528754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374212+0000","last_change":"2024-04-01T15:21:58.518814+0000","last_active":"2024-04-01T15:22:00.374212+0000","last_peered":"2024-04-01T15:22:00.374212+0000","last_clean":"2024-04-01T15:22:00.374212+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:22:00.374212+0000","last_undegraded":"2024-04-01T15:22:00.374212+0000","last_fullsized":"2024-04-01T15:22:00.374212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528497+0000","last_change":"2024-04-01T15:21:58.519850+0000","last_active":"2024-04-01T15:21:59.528497+0000","last_peered":"2024-04-01T15:21:59.528497+0000","last_clean":"2024-04-01T15:21:59.528497+0000","last_became_active":"2024-04-01T15:21:58.519517+0000","last_became_peered":"2024-04-01T15:21:58.519517+0000","last_unstale":"2024-04-01T15:21:59.528497+0000","last_undegraded":"2024-04-01T15:21:59.528497+0000","last_fullsized":"2024-04-01T15:21:59.528497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374983+0000","last_change":"2024-04-01T15:21:58.522961+0000","last_active":"2024-04-01T15:22:00.374983+0000","last_peered":"2024-04-01T15:22:00.374983+0000","last_clean":"2024-04-01T15:22:00.374983+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:22:00.374983+0000","last_undegraded":"2024-04-01T15:22:00.374983+0000","last_fullsized":"2024-04-01T15:22:00.374983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:51:33.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696563+0000","last_change":"2024-04-01T15:21:58.530231+0000","last_active":"2024-04-01T15:21:59.696563+0000","last_peered":"2024-04-01T15:21:59.696563+0000","last_clean":"2024-04-01T15:21:59.696563+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:21:59.696563+0000","last_undegraded":"2024-04-01T15:21:59.696563+0000","last_fullsized":"2024-04-01T15:21:59.696563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374727+0000","last_change":"2024-04-01T15:21:58.526959+0000","last_active":"2024-04-01T15:22:00.374727+0000","last_peered":"2024-04-01T15:22:00.374727+0000","last_clean":"2024-04-01T15:22:00.374727+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:22:00.374727+0000","last_undegraded":"2024-04-01T15:22:00.374727+0000","last_fullsized":"2024-04-01T15:22:00.374727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175156+0000","last_change":"2024-04-01T15:21:58.529489+0000","last_active":"2024-04-01T15:22:00.175156+0000","last_peered":"2024-04-01T15:22:00.175156+0000","last_clean":"2024-04-01T15:22:00.175156+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:22:00.175156+0000","last_undegraded":"2024-04-01T15:22:00.175156+0000","last_fullsized":"2024-04-01T15:22:00.175156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174888+0000","last_change":"2024-04-01T15:21:58.527803+0000","last_active":"2024-04-01T15:22:00.174888+0000","last_peered":"2024-04-01T15:22:00.174888+0000","last_clean":"2024-04-01T15:22:00.174888+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:22:00.174888+0000","last_undegraded":"2024-04-01T15:22:00.174888+0000","last_fullsized":"2024-04-01T15:22:00.174888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525348+0000","last_change":"2024-04-01T15:21:58.535848+0000","last_active":"2024-04-01T15:21:59.525348+0000","last_peered":"2024-04-01T15:21:59.525348+0000","last_clean":"2024-04-01T15:21:59.525348+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:21:59.525348+0000","last_undegraded":"2024-04-01T15:21:59.525348+0000","last_fullsized":"2024-04-01T15:21:59.525348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697039+0000","last_change":"2024-04-01T15:21:58.528912+0000","last_active":"2024-04-01T15:21:59.697039+0000","last_peered":"2024-04-01T15:21:59.697039+0000","last_clean":"2024-04-01T15:21:59.697039+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:21:59.697039+0000","last_undegraded":"2024-04-01T15:21:59.697039+0000","last_fullsized":"2024-04-01T15:21:59.697039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795333+0000","last_change":"2024-04-01T15:21:58.529847+0000","last_active":"2024-04-01T15:22:00.795333+0000","last_peered":"2024-04-01T15:22:00.795333+0000","last_clean":"2024-04-01T15:22:00.795333+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:22:00.795333+0000","last_undegraded":"2024-04-01T15:22:00.795333+0000","last_fullsized":"2024-04-01T15:22:00.795333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:44:07.006946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524893+0000","last_change":"2024-04-01T15:21:58.535414+0000","last_active":"2024-04-01T15:21:59.524893+0000","last_peered":"2024-04-01T15:21:59.524893+0000","last_clean":"2024-04-01T15:21:59.524893+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:21:59.524893+0000","last_undegraded":"2024-04-01T15:21:59.524893+0000","last_fullsized":"2024-04-01T15:21:59.524893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528323+0000","last_change":"2024-04-01T15:21:58.522234+0000","last_active":"2024-04-01T15:21:59.528323+0000","last_peered":"2024-04-01T15:21:59.528323+0000","last_clean":"2024-04-01T15:21:59.528323+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:21:59.528323+0000","last_undegraded":"2024-04-01T15:21:59.528323+0000","last_fullsized":"2024-04-01T15:21:59.528323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.530918+0000","last_change":"2024-04-01T15:21:58.531397+0000","last_active":"2024-04-01T15:21:59.530918+0000","last_peered":"2024-04-01T15:21:59.530918+0000","last_clean":"2024-04-01T15:21:59.530918+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:21:59.530918+0000","last_undegraded":"2024-04-01T15:21:59.530918+0000","last_fullsized":"2024-04-01T15:21:59.530918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.040302+0000","last_change":"2024-04-01T15:21:58.522828+0000","last_active":"2024-04-01T15:22:00.040302+0000","last_peered":"2024-04-01T15:22:00.040302+0000","last_clean":"2024-04-01T15:22:00.040302+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:22:00.040302+0000","last_undegraded":"2024-04-01T15:22:00.040302+0000","last_fullsized":"2024-04-01T15:22:00.040302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373931+0000","last_change":"2024-04-01T15:21:58.532575+0000","last_active":"2024-04-01T15:22:00.373931+0000","last_peered":"2024-04-01T15:22:00.373931+0000","last_clean":"2024-04-01T15:22:00.373931+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:22:00.373931+0000","last_undegraded":"2024-04-01T15:22:00.373931+0000","last_fullsized":"2024-04-01T15:22:00.373931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174864+0000","last_change":"2024-04-01T15:21:58.530543+0000","last_active":"2024-04-01T15:22:00.174864+0000","last_peered":"2024-04-01T15:22:00.174864+0000","last_clean":"2024-04-01T15:22:00.174864+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:22:00.174864+0000","last_undegraded":"2024-04-01T15:22:00.174864+0000","last_fullsized":"2024-04-01T15:22:00.174864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795532+0000","last_change":"2024-04-01T15:21:58.528377+0000","last_active":"2024-04-01T15:22:00.795532+0000","last_peered":"2024-04-01T15:22:00.795532+0000","last_clean":"2024-04-01T15:22:00.795532+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:22:00.795532+0000","last_undegraded":"2024-04-01T15:22:00.795532+0000","last_fullsized":"2024-04-01T15:22:00.795532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:56:09.008728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528834+0000","last_change":"2024-04-01T15:21:58.530746+0000","last_active":"2024-04-01T15:21:59.528834+0000","last_peered":"2024-04-01T15:21:59.528834+0000","last_clean":"2024-04-01T15:21:59.528834+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:21:59.528834+0000","last_undegraded":"2024-04-01T15:21:59.528834+0000","last_fullsized":"2024-04-01T15:21:59.528834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696730+0000","last_change":"2024-04-01T15:21:58.516408+0000","last_active":"2024-04-01T15:21:59.696730+0000","last_peered":"2024-04-01T15:21:59.696730+0000","last_clean":"2024-04-01T15:21:59.696730+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:21:59.696730+0000","last_undegraded":"2024-04-01T15:21:59.696730+0000","last_fullsized":"2024-04-01T15:21:59.696730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528199+0000","last_change":"2024-04-01T15:21:58.525868+0000","last_active":"2024-04-01T15:21:59.528199+0000","last_peered":"2024-04-01T15:21:59.528199+0000","last_clean":"2024-04-01T15:21:59.528199+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:21:59.528199+0000","last_undegraded":"2024-04-01T15:21:59.528199+0000","last_fullsized":"2024-04-01T15:21:59.528199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697382+0000","last_change":"2024-04-01T15:21:58.531952+0000","last_active":"2024-04-01T15:21:59.697382+0000","last_peered":"2024-04-01T15:21:59.697382+0000","last_clean":"2024-04-01T15:21:59.697382+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:21:59.697382+0000","last_undegraded":"2024-04-01T15:21:59.697382+0000","last_fullsized":"2024-04-01T15:21:59.697382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175425+0000","last_change":"2024-04-01T15:21:58.517341+0000","last_active":"2024-04-01T15:22:00.175425+0000","last_peered":"2024-04-01T15:22:00.175425+0000","last_clean":"2024-04-01T15:22:00.175425+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:22:00.175425+0000","last_undegraded":"2024-04-01T15:22:00.175425+0000","last_fullsized":"2024-04-01T15:22:00.175425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525136+0000","last_change":"2024-04-01T15:21:58.535087+0000","last_active":"2024-04-01T15:21:59.525136+0000","last_peered":"2024-04-01T15:21:59.525136+0000","last_clean":"2024-04-01T15:21:59.525136+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:21:59.525136+0000","last_undegraded":"2024-04-01T15:21:59.525136+0000","last_fullsized":"2024-04-01T15:21:59.525136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697491+0000","last_change":"2024-04-01T15:21:58.531487+0000","last_active":"2024-04-01T15:21:59.697491+0000","last_peered":"2024-04-01T15:21:59.697491+0000","last_clean":"2024-04-01T15:21:59.697491+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:21:59.697491+0000","last_undegraded":"2024-04-01T15:21:59.697491+0000","last_fullsized":"2024-04-01T15:21:59.697491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795574+0000","last_change":"2024-04-01T15:21:58.531305+0000","last_active":"2024-04-01T15:22:00.795574+0000","last_peered":"2024-04-01T15:22:00.795574+0000","last_clean":"2024-04-01T15:22:00.795574+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:22:00.795574+0000","last_undegraded":"2024-04-01T15:22:00.795574+0000","last_fullsized":"2024-04-01T15:22:00.795574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528885+0000","last_change":"2024-04-01T15:21:58.530998+0000","last_active":"2024-04-01T15:21:59.528885+0000","last_peered":"2024-04-01T15:21:59.528885+0000","last_clean":"2024-04-01T15:21:59.528885+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:21:59.528885+0000","last_undegraded":"2024-04-01T15:21:59.528885+0000","last_fullsized":"2024-04-01T15:21:59.528885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039960+0000","last_change":"2024-04-01T15:21:58.523119+0000","last_active":"2024-04-01T15:22:00.039960+0000","last_peered":"2024-04-01T15:22:00.039960+0000","last_clean":"2024-04-01T15:22:00.039960+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:22:00.039960+0000","last_undegraded":"2024-04-01T15:22:00.039960+0000","last_fullsized":"2024-04-01T15:22:00.039960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174268+0000","last_change":"2024-04-01T15:21:58.514302+0000","last_active":"2024-04-01T15:22:00.174268+0000","last_peered":"2024-04-01T15:22:00.174268+0000","last_clean":"2024-04-01T15:22:00.174268+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:22:00.174268+0000","last_undegraded":"2024-04-01T15:22:00.174268+0000","last_fullsized":"2024-04-01T15:22:00.174268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524902+0000","last_change":"2024-04-01T15:21:58.528525+0000","last_active":"2024-04-01T15:21:59.524902+0000","last_peered":"2024-04-01T15:21:59.524902+0000","last_clean":"2024-04-01T15:21:59.524902+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:21:59.524902+0000","last_undegraded":"2024-04-01T15:21:59.524902+0000","last_fullsized":"2024-04-01T15:21:59.524902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:58.054203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697111+0000","last_change":"2024-04-01T15:21:57.523557+0000","last_active":"2024-04-01T15:21:59.697111+0000","last_peered":"2024-04-01T15:21:59.697111+0000","last_clean":"2024-04-01T15:21:59.697111+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:21:59.697111+0000","last_undegraded":"2024-04-01T15:21:59.697111+0000","last_fullsized":"2024-04-01T15:21:59.697111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795700+0000","last_change":"2024-04-01T15:21:58.531570+0000","last_active":"2024-04-01T15:22:00.795700+0000","last_peered":"2024-04-01T15:22:00.795700+0000","last_clean":"2024-04-01T15:22:00.795700+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:22:00.795700+0000","last_undegraded":"2024-04-01T15:22:00.795700+0000","last_fullsized":"2024-04-01T15:22:00.795700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174511+0000","last_change":"2024-04-01T15:21:57.519248+0000","last_active":"2024-04-01T15:22:00.174511+0000","last_peered":"2024-04-01T15:22:00.174511+0000","last_clean":"2024-04-01T15:22:00.174511+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:22:00.174511+0000","last_undegraded":"2024-04-01T15:22:00.174511+0000","last_fullsized":"2024-04-01T15:22:00.174511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696520+0000","last_change":"2024-04-01T15:21:57.518727+0000","last_active":"2024-04-01T15:21:59.696520+0000","last_peered":"2024-04-01T15:21:59.696520+0000","last_clean":"2024-04-01T15:21:59.696520+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:21:59.696520+0000","last_undegraded":"2024-04-01T15:21:59.696520+0000","last_fullsized":"2024-04-01T15:21:59.696520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:15:36.993209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696524+0000","last_change":"2024-04-01T15:21:58.527894+0000","last_active":"2024-04-01T15:21:59.696524+0000","last_peered":"2024-04-01T15:21:59.696524+0000","last_clean":"2024-04-01T15:21:59.696524+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:21:59.696524+0000","last_undegraded":"2024-04-01T15:21:59.696524+0000","last_fullsized":"2024-04-01T15:21:59.696524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528268+0000","last_change":"2024-04-01T15:21:57.534982+0000","last_active":"2024-04-01T15:21:59.528268+0000","last_peered":"2024-04-01T15:21:59.528268+0000","last_clean":"2024-04-01T15:21:59.528268+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:21:59.528268+0000","last_undegraded":"2024-04-01T15:21:59.528268+0000","last_fullsized":"2024-04-01T15:21:59.528268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524398+0000","last_change":"2024-04-01T15:21:58.525017+0000","last_active":"2024-04-01T15:21:59.524398+0000","last_peered":"2024-04-01T15:21:59.524398+0000","last_clean":"2024-04-01T15:21:59.524398+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:21:59.524398+0000","last_undegraded":"2024-04-01T15:21:59.524398+0000","last_fullsized":"2024-04-01T15:21:59.524398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175037+0000","last_change":"2024-04-01T15:21:57.528840+0000","last_active":"2024-04-01T15:22:00.175037+0000","last_peered":"2024-04-01T15:22:00.175037+0000","last_clean":"2024-04-01T15:22:00.175037+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:22:00.175037+0000","last_undegraded":"2024-04-01T15:22:00.175037+0000","last_fullsized":"2024-04-01T15:22:00.175037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529666+0000","last_change":"2024-04-01T15:21:58.529422+0000","last_active":"2024-04-01T15:21:59.529666+0000","last_peered":"2024-04-01T15:21:59.529666+0000","last_clean":"2024-04-01T15:21:59.529666+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:21:59.529666+0000","last_undegraded":"2024-04-01T15:21:59.529666+0000","last_fullsized":"2024-04-01T15:21:59.529666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529803+0000","last_change":"2024-04-01T15:21:57.528345+0000","last_active":"2024-04-01T15:21:59.529803+0000","last_peered":"2024-04-01T15:21:59.529803+0000","last_clean":"2024-04-01T15:21:59.529803+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:21:59.529803+0000","last_undegraded":"2024-04-01T15:21:59.529803+0000","last_fullsized":"2024-04-01T15:21:59.529803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795783+0000","last_change":"2024-04-01T15:21:58.529376+0000","last_active":"2024-04-01T15:22:00.795783+0000","last_peered":"2024-04-01T15:22:00.795783+0000","last_clean":"2024-04-01T15:22:00.795783+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:22:00.795783+0000","last_undegraded":"2024-04-01T15:22:00.795783+0000","last_fullsized":"2024-04-01T15:22:00.795783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524861+0000","last_change":"2024-04-01T15:21:57.526610+0000","last_active":"2024-04-01T15:21:59.524861+0000","last_peered":"2024-04-01T15:21:59.524861+0000","last_clean":"2024-04-01T15:21:59.524861+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:21:59.524861+0000","last_undegraded":"2024-04-01T15:21:59.524861+0000","last_fullsized":"2024-04-01T15:21:59.524861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525355+0000","last_change":"2024-04-01T15:21:58.537476+0000","last_active":"2024-04-01T15:21:59.525355+0000","last_peered":"2024-04-01T15:21:59.525355+0000","last_clean":"2024-04-01T15:21:59.525355+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:21:59.525355+0000","last_undegraded":"2024-04-01T15:21:59.525355+0000","last_fullsized":"2024-04-01T15:21:59.525355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174501+0000","last_change":"2024-04-01T15:21:57.513766+0000","last_active":"2024-04-01T15:22:00.174501+0000","last_peered":"2024-04-01T15:22:00.174501+0000","last_clean":"2024-04-01T15:22:00.174501+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:22:00.174501+0000","last_undegraded":"2024-04-01T15:22:00.174501+0000","last_fullsized":"2024-04-01T15:22:00.174501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373572+0000","last_change":"2024-04-01T15:21:58.539751+0000","last_active":"2024-04-01T15:22:00.373572+0000","last_peered":"2024-04-01T15:22:00.373572+0000","last_clean":"2024-04-01T15:22:00.373572+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:22:00.373572+0000","last_undegraded":"2024-04-01T15:22:00.373572+0000","last_fullsized":"2024-04-01T15:22:00.373572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795635+0000","last_change":"2024-04-01T15:21:57.520158+0000","last_active":"2024-04-01T15:22:00.795635+0000","last_peered":"2024-04-01T15:22:00.795635+0000","last_clean":"2024-04-01T15:22:00.795635+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:22:00.795635+0000","last_undegraded":"2024-04-01T15:22:00.795635+0000","last_fullsized":"2024-04-01T15:22:00.795635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795381+0000","last_change":"2024-04-01T15:21:58.532249+0000","last_active":"2024-04-01T15:22:00.795381+0000","last_peered":"2024-04-01T15:22:00.795381+0000","last_clean":"2024-04-01T15:22:00.795381+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:22:00.795381+0000","last_undegraded":"2024-04-01T15:22:00.795381+0000","last_fullsized":"2024-04-01T15:22:00.795381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.229948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529411+0000","last_change":"2024-04-01T15:21:57.528780+0000","last_active":"2024-04-01T15:21:59.529411+0000","last_peered":"2024-04-01T15:21:59.529411+0000","last_clean":"2024-04-01T15:21:59.529411+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:21:59.529411+0000","last_undegraded":"2024-04-01T15:21:59.529411+0000","last_fullsized":"2024-04-01T15:21:59.529411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374292+0000","last_change":"2024-04-01T15:21:58.528458+0000","last_active":"2024-04-01T15:22:00.374292+0000","last_peered":"2024-04-01T15:22:00.374292+0000","last_clean":"2024-04-01T15:22:00.374292+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:22:00.374292+0000","last_undegraded":"2024-04-01T15:22:00.374292+0000","last_fullsized":"2024-04-01T15:22:00.374292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174063+0000","last_change":"2024-04-01T15:21:57.528026+0000","last_active":"2024-04-01T15:22:00.174063+0000","last_peered":"2024-04-01T15:22:00.174063+0000","last_clean":"2024-04-01T15:22:00.174063+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:22:00.174063+0000","last_undegraded":"2024-04-01T15:22:00.174063+0000","last_fullsized":"2024-04-01T15:22:00.174063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174372+0000","last_change":"2024-04-01T15:21:58.514047+0000","last_active":"2024-04-01T15:22:00.174372+0000","last_peered":"2024-04-01T15:22:00.174372+0000","last_clean":"2024-04-01T15:22:00.174372+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:22:00.174372+0000","last_undegraded":"2024-04-01T15:22:00.174372+0000","last_fullsized":"2024-04-01T15:22:00.174372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039609+0000","last_change":"2024-04-01T15:21:57.517184+0000","last_active":"2024-04-01T15:22:00.039609+0000","last_peered":"2024-04-01T15:22:00.039609+0000","last_clean":"2024-04-01T15:22:00.039609+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:22:00.039609+0000","last_undegraded":"2024-04-01T15:22:00.039609+0000","last_fullsized":"2024-04-01T15:22:00.039609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374874+0000","last_change":"2024-04-01T15:21:58.529946+0000","last_active":"2024-04-01T15:22:00.374874+0000","last_peered":"2024-04-01T15:22:00.374874+0000","last_clean":"2024-04-01T15:22:00.374874+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:22:00.374874+0000","last_undegraded":"2024-04-01T15:22:00.374874+0000","last_fullsized":"2024-04-01T15:22:00.374874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525712+0000","last_change":"2024-04-01T15:21:57.519642+0000","last_active":"2024-04-01T15:21:59.525712+0000","last_peered":"2024-04-01T15:21:59.525712+0000","last_clean":"2024-04-01T15:21:59.525712+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:21:59.525712+0000","last_undegraded":"2024-04-01T15:21:59.525712+0000","last_fullsized":"2024-04-01T15:21:59.525712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:09:07.894019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374100+0000","last_change":"2024-04-01T15:21:58.529121+0000","last_active":"2024-04-01T15:22:00.374100+0000","last_peered":"2024-04-01T15:22:00.374100+0000","last_clean":"2024-04-01T15:22:00.374100+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:22:00.374100+0000","last_undegraded":"2024-04-01T15:22:00.374100+0000","last_fullsized":"2024-04-01T15:22:00.374100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039988+0000","last_change":"2024-04-01T15:21:57.514455+0000","last_active":"2024-04-01T15:22:00.039988+0000","last_peered":"2024-04-01T15:22:00.039988+0000","last_clean":"2024-04-01T15:22:00.039988+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:22:00.039988+0000","last_undegraded":"2024-04-01T15:22:00.039988+0000","last_fullsized":"2024-04-01T15:22:00.039988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374717+0000","last_change":"2024-04-01T15:21:58.535610+0000","last_active":"2024-04-01T15:22:00.374717+0000","last_peered":"2024-04-01T15:22:00.374717+0000","last_clean":"2024-04-01T15:22:00.374717+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:22:00.374717+0000","last_undegraded":"2024-04-01T15:22:00.374717+0000","last_fullsized":"2024-04-01T15:22:00.374717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524990+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:21:59.524990+0000","last_peered":"2024-04-01T15:21:59.524990+0000","last_clean":"2024-04-01T15:21:59.524990+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:21:59.524990+0000","last_undegraded":"2024-04-01T15:21:59.524990+0000","last_fullsized":"2024-04-01T15:21:59.524990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529157+0000","last_change":"2024-04-01T15:21:58.533365+0000","last_active":"2024-04-01T15:21:59.529157+0000","last_peered":"2024-04-01T15:21:59.529157+0000","last_clean":"2024-04-01T15:21:59.529157+0000","last_became_active":"2024-04-01T15:21:58.533141+0000","last_became_peered":"2024-04-01T15:21:58.533141+0000","last_unstale":"2024-04-01T15:21:59.529157+0000","last_undegraded":"2024-04-01T15:21:59.529157+0000","last_fullsized":"2024-04-01T15:21:59.529157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039888+0000","last_change":"2024-04-01T15:21:57.532167+0000","last_active":"2024-04-01T15:22:00.039888+0000","last_peered":"2024-04-01T15:22:00.039888+0000","last_clean":"2024-04-01T15:22:00.039888+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:22:00.039888+0000","last_undegraded":"2024-04-01T15:22:00.039888+0000","last_fullsized":"2024-04-01T15:22:00.039888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373757+0000","last_change":"2024-04-01T15:21:58.530108+0000","last_active":"2024-04-01T15:22:00.373757+0000","last_peered":"2024-04-01T15:22:00.373757+0000","last_clean":"2024-04-01T15:22:00.373757+0000","last_became_active":"2024-04-01T15:21:58.529794+0000","last_became_peered":"2024-04-01T15:21:58.529794+0000","last_unstale":"2024-04-01T15:22:00.373757+0000","last_undegraded":"2024-04-01T15:22:00.373757+0000","last_fullsized":"2024-04-01T15:22:00.373757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373799+0000","last_change":"2024-04-01T15:21:47.878530+0000","last_active":"2024-04-01T15:22:00.373799+0000","last_peered":"2024-04-01T15:22:00.373799+0000","last_clean":"2024-04-01T15:22:00.373799+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:22:00.373799+0000","last_undegraded":"2024-04-01T15:22:00.373799+0000","last_fullsized":"2024-04-01T15:22:00.373799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_clean_scrub_stamp":"2024-04-01T15:21:46.852307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:25:18.137507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528321+0000","last_change":"2024-04-01T15:21:57.530394+0000","last_active":"2024-04-01T15:21:59.528321+0000","last_peered":"2024-04-01T15:21:59.528321+0000","last_clean":"2024-04-01T15:21:59.528321+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:21:59.528321+0000","last_undegraded":"2024-04-01T15:21:59.528321+0000","last_fullsized":"2024-04-01T15:21:59.528321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697106+0000","last_change":"2024-04-01T15:21:58.529751+0000","last_active":"2024-04-01T15:21:59.697106+0000","last_peered":"2024-04-01T15:21:59.697106+0000","last_clean":"2024-04-01T15:21:59.697106+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:21:59.697106+0000","last_undegraded":"2024-04-01T15:21:59.697106+0000","last_fullsized":"2024-04-01T15:21:59.697106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373518+0000","last_change":"2024-04-01T15:21:57.526919+0000","last_active":"2024-04-01T15:22:00.373518+0000","last_peered":"2024-04-01T15:22:00.373518+0000","last_clean":"2024-04-01T15:22:00.373518+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:22:00.373518+0000","last_undegraded":"2024-04-01T15:22:00.373518+0000","last_fullsized":"2024-04-01T15:22:00.373518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.796128+0000","last_change":"2024-04-01T15:21:58.525329+0000","last_active":"2024-04-01T15:22:00.796128+0000","last_peered":"2024-04-01T15:22:00.796128+0000","last_clean":"2024-04-01T15:22:00.796128+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:22:00.796128+0000","last_undegraded":"2024-04-01T15:22:00.796128+0000","last_fullsized":"2024-04-01T15:22:00.796128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.040177+0000","last_change":"2024-04-01T15:21:57.511176+0000","last_active":"2024-04-01T15:22:00.040177+0000","last_peered":"2024-04-01T15:22:00.040177+0000","last_clean":"2024-04-01T15:22:00.040177+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:22:00.040177+0000","last_undegraded":"2024-04-01T15:22:00.040177+0000","last_fullsized":"2024-04-01T15:22:00.040177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524559+0000","last_change":"2024-04-01T15:21:58.523794+0000","last_active":"2024-04-01T15:21:59.524559+0000","last_peered":"2024-04-01T15:21:59.524559+0000","last_clean":"2024-04-01T15:21:59.524559+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:21:59.524559+0000","last_undegraded":"2024-04-01T15:21:59.524559+0000","last_fullsized":"2024-04-01T15:21:59.524559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529840+0000","last_change":"2024-04-01T15:21:57.527763+0000","last_active":"2024-04-01T15:21:59.529840+0000","last_peered":"2024-04-01T15:21:59.529840+0000","last_clean":"2024-04-01T15:21:59.529840+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:21:59.529840+0000","last_undegraded":"2024-04-01T15:21:59.529840+0000","last_fullsized":"2024-04-01T15:21:59.529840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524921+0000","last_change":"2024-04-01T15:21:58.531026+0000","last_active":"2024-04-01T15:21:59.524921+0000","last_peered":"2024-04-01T15:21:59.524921+0000","last_clean":"2024-04-01T15:21:59.524921+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:21:59.524921+0000","last_undegraded":"2024-04-01T15:21:59.524921+0000","last_fullsized":"2024-04-01T15:21:59.524921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:50.706762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524830+0000","last_change":"2024-04-01T15:21:57.517159+0000","last_active":"2024-04-01T15:21:59.524830+0000","last_peered":"2024-04-01T15:21:59.524830+0000","last_clean":"2024-04-01T15:21:59.524830+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:21:59.524830+0000","last_undegraded":"2024-04-01T15:21:59.524830+0000","last_fullsized":"2024-04-01T15:21:59.524830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529965+0000","last_change":"2024-04-01T15:21:58.541348+0000","last_active":"2024-04-01T15:21:59.529965+0000","last_peered":"2024-04-01T15:21:59.529965+0000","last_clean":"2024-04-01T15:21:59.529965+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:21:59.529965+0000","last_undegraded":"2024-04-01T15:21:59.529965+0000","last_fullsized":"2024-04-01T15:21:59.529965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373995+0000","last_change":"2024-04-01T15:21:57.526914+0000","last_active":"2024-04-01T15:22:00.373995+0000","last_peered":"2024-04-01T15:22:00.373995+0000","last_clean":"2024-04-01T15:22:00.373995+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:22:00.373995+0000","last_undegraded":"2024-04-01T15:22:00.373995+0000","last_fullsized":"2024-04-01T15:22:00.373995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524661+0000","last_change":"2024-04-01T15:21:58.515834+0000","last_active":"2024-04-01T15:21:59.524661+0000","last_peered":"2024-04-01T15:21:59.524661+0000","last_clean":"2024-04-01T15:21:59.524661+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:21:59.524661+0000","last_undegraded":"2024-04-01T15:21:59.524661+0000","last_fullsized":"2024-04-01T15:21:59.524661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525272+0000","last_change":"2024-04-01T15:21:57.533452+0000","last_active":"2024-04-01T15:21:59.525272+0000","last_peered":"2024-04-01T15:21:59.525272+0000","last_clean":"2024-04-01T15:21:59.525272+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:21:59.525272+0000","last_undegraded":"2024-04-01T15:21:59.525272+0000","last_fullsized":"2024-04-01T15:21:59.525272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697608+0000","last_change":"2024-04-01T15:21:58.512191+0000","last_active":"2024-04-01T15:21:59.697608+0000","last_peered":"2024-04-01T15:21:59.697608+0000","last_clean":"2024-04-01T15:21:59.697608+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:21:59.697608+0000","last_undegraded":"2024-04-01T15:21:59.697608+0000","last_fullsized":"2024-04-01T15:21:59.697608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175206+0000","last_change":"2024-04-01T15:21:57.526196+0000","last_active":"2024-04-01T15:22:00.175206+0000","last_peered":"2024-04-01T15:22:00.175206+0000","last_clean":"2024-04-01T15:22:00.175206+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:22:00.175206+0000","last_undegraded":"2024-04-01T15:22:00.175206+0000","last_fullsized":"2024-04-01T15:22:00.175206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795819+0000","last_change":"2024-04-01T15:21:58.526739+0000","last_active":"2024-04-01T15:22:00.795819+0000","last_peered":"2024-04-01T15:22:00.795819+0000","last_clean":"2024-04-01T15:22:00.795819+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:22:00.795819+0000","last_undegraded":"2024-04-01T15:22:00.795819+0000","last_fullsized":"2024-04-01T15:22:00.795819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373249+0000","last_change":"2024-04-01T15:21:57.526924+0000","last_active":"2024-04-01T15:22:00.373249+0000","last_peered":"2024-04-01T15:22:00.373249+0000","last_clean":"2024-04-01T15:22:00.373249+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:22:00.373249+0000","last_undegraded":"2024-04-01T15:22:00.373249+0000","last_fullsized":"2024-04-01T15:22:00.373249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524505+0000","last_change":"2024-04-01T15:21:58.528396+0000","last_active":"2024-04-01T15:21:59.524505+0000","last_peered":"2024-04-01T15:21:59.524505+0000","last_clean":"2024-04-01T15:21:59.524505+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:21:59.524505+0000","last_undegraded":"2024-04-01T15:21:59.524505+0000","last_fullsized":"2024-04-01T15:21:59.524505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:50.943225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525048+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:21:59.525048+0000","last_peered":"2024-04-01T15:21:59.525048+0000","last_clean":"2024-04-01T15:21:59.525048+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:21:59.525048+0000","last_undegraded":"2024-04-01T15:21:59.525048+0000","last_fullsized":"2024-04-01T15:21:59.525048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:09.572891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696891+0000","last_change":"2024-04-01T15:21:58.529955+0000","last_active":"2024-04-01T15:21:59.696891+0000","last_peered":"2024-04-01T15:21:59.696891+0000","last_clean":"2024-04-01T15:21:59.696891+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:21:59.696891+0000","last_undegraded":"2024-04-01T15:21:59.696891+0000","last_fullsized":"2024-04-01T15:21:59.696891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524416+0000","last_change":"2024-04-01T15:21:57.526620+0000","last_active":"2024-04-01T15:21:59.524416+0000","last_peered":"2024-04-01T15:21:59.524416+0000","last_clean":"2024-04-01T15:21:59.524416+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:21:59.524416+0000","last_undegraded":"2024-04-01T15:21:59.524416+0000","last_fullsized":"2024-04-01T15:21:59.524416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697310+0000","last_change":"2024-04-01T15:21:58.534484+0000","last_active":"2024-04-01T15:21:59.697310+0000","last_peered":"2024-04-01T15:21:59.697310+0000","last_clean":"2024-04-01T15:21:59.697310+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:21:59.697310+0000","last_undegraded":"2024-04-01T15:21:59.697310+0000","last_fullsized":"2024-04-01T15:21:59.697310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374424+0000","last_change":"2024-04-01T15:21:57.531639+0000","last_active":"2024-04-01T15:22:00.374424+0000","last_peered":"2024-04-01T15:22:00.374424+0000","last_clean":"2024-04-01T15:22:00.374424+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:22:00.374424+0000","last_undegraded":"2024-04-01T15:22:00.374424+0000","last_fullsized":"2024-04-01T15:22:00.374424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174380+0000","last_change":"2024-04-01T15:21:58.523366+0000","last_active":"2024-04-01T15:22:00.174380+0000","last_peered":"2024-04-01T15:22:00.174380+0000","last_clean":"2024-04-01T15:22:00.174380+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:22:00.174380+0000","last_undegraded":"2024-04-01T15:22:00.174380+0000","last_fullsized":"2024-04-01T15:22:00.174380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529585+0000","last_change":"2024-04-01T15:21:58.526457+0000","last_active":"2024-04-01T15:21:59.529585+0000","last_peered":"2024-04-01T15:21:59.529585+0000","last_clean":"2024-04-01T15:21:59.529585+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:21:59.529585+0000","last_undegraded":"2024-04-01T15:21:59.529585+0000","last_fullsized":"2024-04-01T15:21:59.529585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373310+0000","last_change":"2024-04-01T15:21:57.534510+0000","last_active":"2024-04-01T15:22:00.373310+0000","last_peered":"2024-04-01T15:22:00.373310+0000","last_clean":"2024-04-01T15:22:00.373310+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:22:00.373310+0000","last_undegraded":"2024-04-01T15:22:00.373310+0000","last_fullsized":"2024-04-01T15:22:00.373310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528978+0000","last_change":"2024-04-01T15:21:58.537101+0000","last_active":"2024-04-01T15:21:59.528978+0000","last_peered":"2024-04-01T15:21:59.528978+0000","last_clean":"2024-04-01T15:21:59.528978+0000","last_became_active":"2024-04-01T15:21:58.536776+0000","last_became_peered":"2024-04-01T15:21:58.536776+0000","last_unstale":"2024-04-01T15:21:59.528978+0000","last_undegraded":"2024-04-01T15:21:59.528978+0000","last_fullsized":"2024-04-01T15:21:59.528978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373757+0000","last_change":"2024-04-01T15:21:57.533797+0000","last_active":"2024-04-01T15:22:00.373757+0000","last_peered":"2024-04-01T15:22:00.373757+0000","last_clean":"2024-04-01T15:22:00.373757+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:22:00.373757+0000","last_undegraded":"2024-04-01T15:22:00.373757+0000","last_fullsized":"2024-04-01T15:22:00.373757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:16:16.205030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795639+0000","last_change":"2024-04-01T15:21:58.524922+0000","last_active":"2024-04-01T15:22:00.795639+0000","last_peered":"2024-04-01T15:22:00.795639+0000","last_clean":"2024-04-01T15:22:00.795639+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:22:00.795639+0000","last_undegraded":"2024-04-01T15:22:00.795639+0000","last_fullsized":"2024-04-01T15:22:00.795639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697725+0000","last_change":"2024-04-01T15:21:57.518934+0000","last_active":"2024-04-01T15:21:59.697725+0000","last_peered":"2024-04-01T15:21:59.697725+0000","last_clean":"2024-04-01T15:21:59.697725+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:21:59.697725+0000","last_undegraded":"2024-04-01T15:21:59.697725+0000","last_fullsized":"2024-04-01T15:21:59.697725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697866+0000","last_change":"2024-04-01T15:21:58.538259+0000","last_active":"2024-04-01T15:21:59.697866+0000","last_peered":"2024-04-01T15:21:59.697866+0000","last_clean":"2024-04-01T15:21:59.697866+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:21:59.697866+0000","last_undegraded":"2024-04-01T15:21:59.697866+0000","last_fullsized":"2024-04-01T15:21:59.697866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795827+0000","last_change":"2024-04-01T15:21:57.524507+0000","last_active":"2024-04-01T15:22:00.795827+0000","last_peered":"2024-04-01T15:22:00.795827+0000","last_clean":"2024-04-01T15:22:00.795827+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:22:00.795827+0000","last_undegraded":"2024-04-01T15:22:00.795827+0000","last_fullsized":"2024-04-01T15:22:00.795827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:29:44.659776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:22:03.473 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-01T15:22:03.473 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-01T15:22:03.473 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-01T15:22:03.474 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-01T15:22:03.474 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-01T15:22:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.720+0000 7fb014000640 1 Processor -- start 2024-04-01T15:22:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.720+0000 7fb014000640 1 -- start start 2024-04-01T15:22:03.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.721+0000 7fb014000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb00c06d8d0 0x7fb00c0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.721+0000 7fb014000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb00c0af030 0x7fb00c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.721+0000 7fb014000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00c0b56b0 con 0x7fb00c0b3cd0 2024-04-01T15:22:03.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.721+0000 7fb014000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb00c0ae660 con 0x7fb00c0af030 2024-04-01T15:22:03.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.721+0000 7fb014000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fb00c0af490 con 0x7fb00c06d8d0 2024-04-01T15:22:03.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.722+0000 7fb010c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb00c0af030 0x7fb00c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.722+0000 7fb010c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb00c0af030 0x7fb00c0b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59930/0 (socket says 172.21.15.142:59930) 2024-04-01T15:22:03.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.722+0000 7fb010c00640 1 -- 172.21.15.142:0/1323003397 learned_addr learned my addr 172.21.15.142:0/1323003397 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:03.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.722+0000 7fb011600640 1 --2- 172.21.15.142:0/1323003397 >> v2:172.21.15.179:3300/0 conn(0x7fb00c06d8d0 0x7fb00c0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.722+0000 7fb010c00640 1 -- 172.21.15.142:0/1323003397 >> v2:172.21.15.179:3300/0 conn(0x7fb00c06d8d0 msgr2=0x7fb00c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:03.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.722+0000 7fb010c00640 1 --2- 172.21.15.142:0/1323003397 >> v2:172.21.15.179:3300/0 conn(0x7fb00c06d8d0 0x7fb00c0aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.722+0000 7fb010c00640 1 -- 172.21.15.142:0/1323003397 >> v1:172.21.15.179:6789/0 conn(0x7fb00c0b3cd0 legacy=0x7fb00c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.722+0000 7fb010c00640 1 -- 172.21.15.142:0/1323003397 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00c06dcb0 con 0x7fb00c0af030 2024-04-01T15:22:03.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.723+0000 7fb010c00640 1 --2- 172.21.15.142:0/1323003397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c0af030 0x7fb00c0b3790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0b6640 tx=0x7faff802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1299916075c8bc20 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:03.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.723+0000 7fb00be00640 1 -- 172.21.15.142:0/1323003397 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff802e070 con 0x7fb00c0af030 2024-04-01T15:22:03.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.723+0000 7fb00be00640 1 -- 172.21.15.142:0/1323003397 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff8037070 con 0x7fb00c0af030 2024-04-01T15:22:03.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.724+0000 7fb00be00640 1 -- 172.21.15.142:0/1323003397 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8031a00 con 0x7fb00c0af030 2024-04-01T15:22:03.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.724+0000 7fb014000640 1 -- 172.21.15.142:0/1323003397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c0af030 msgr2=0x7fb00c0b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.724+0000 7fb014000640 1 --2- 172.21.15.142:0/1323003397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c0af030 0x7fb00c0b3790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0b6640 tx=0x7faff802b880 comp rx=0 tx=0).stop 2024-04-01T15:22:03.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.724+0000 7fb014000640 1 -- 172.21.15.142:0/1323003397 shutdown_connections 2024-04-01T15:22:03.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.724+0000 7fb014000640 1 --2- 172.21.15.142:0/1323003397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c0af030 0x7fb00c0b3790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.724+0000 7fb014000640 1 --2- 172.21.15.142:0/1323003397 >> v2:172.21.15.179:3300/0 conn(0x7fb00c06d8d0 0x7fb00c0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.724+0000 7fb014000640 1 -- 172.21.15.142:0/1323003397 >> 172.21.15.142:0/1323003397 conn(0x7fb00c0b5890 msgr2=0x7fb00c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:03.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.724+0000 7fb014000640 1 -- 172.21.15.142:0/1323003397 shutdown_connections 2024-04-01T15:22:03.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.724+0000 7fb014000640 1 -- 172.21.15.142:0/1323003397 wait complete. 2024-04-01T15:22:03.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.726+0000 7fb014000640 1 Processor -- start 2024-04-01T15:22:03.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.726+0000 7fb014000640 1 -- start start 2024-04-01T15:22:03.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb014000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c06d8d0 0x7fb00c072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb014000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb00c0af030 0x7fb00c070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb014000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb00c0b3cd0 0x7fb00c071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb014000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c0b53d0 con 0x7fb00c06d8d0 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb014000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c0b03c0 con 0x7fb00c0b3cd0 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb014000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb00c0afd70 con 0x7fb00c0af030 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb011600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c06d8d0 0x7fb00c072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb011600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c06d8d0 0x7fb00c072310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59936/0 (socket says 172.21.15.142:59936) 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb011600640 1 -- 172.21.15.142:0/1072142453 learned_addr learned my addr 172.21.15.142:0/1072142453 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb011600640 1 -- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb00c0af030 msgr2=0x7fb00c070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb011600640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb00c0af030 0x7fb00c070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb011600640 1 -- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb00c0b3cd0 msgr2=0x7fb00c071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb011600640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb00c0b3cd0 0x7fb00c071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb011600640 1 -- 172.21.15.142:0/1072142453 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00c072850 con 0x7fb00c06d8d0 2024-04-01T15:22:03.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.727+0000 7fb011600640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c06d8d0 0x7fb00c072310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb00000e960 tx=0x7fb00000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:03.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.728+0000 7fb009600640 1 -- 172.21.15.142:0/1072142453 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000017070 con 0x7fb00c06d8d0 2024-04-01T15:22:03.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.728+0000 7fb009600640 1 -- 172.21.15.142:0/1072142453 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00000ca00 con 0x7fb00c06d8d0 2024-04-01T15:22:03.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.728+0000 7fb009600640 1 -- 172.21.15.142:0/1072142453 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00000cdf0 con 0x7fb00c06d8d0 2024-04-01T15:22:03.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.728+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00c1467e0 con 0x7fb00c06d8d0 2024-04-01T15:22:03.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.728+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00c070100 con 0x7fb00c06d8d0 2024-04-01T15:22:03.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.729+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb00c068710 con 0x7fb00c06d8d0 2024-04-01T15:22:03.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.730+0000 7fb009600640 1 -- 172.21.15.142:0/1072142453 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb00001a070 con 0x7fb00c06d8d0 2024-04-01T15:22:03.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.731+0000 7fb009600640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fafec06c8f0 0x7fafec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:03.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.731+0000 7fb009600640 1 -- 172.21.15.142:0/1072142453 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb00008bb90 con 0x7fb00c06d8d0 2024-04-01T15:22:03.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.732+0000 7fb010c00640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fafec06c8f0 0x7fafec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:03.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.733+0000 7fb010c00640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fafec06c8f0 0x7fafec06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faff8036000 tx=0x7faff8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:03.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.735+0000 7fb009600640 1 -- 172.21.15.142:0/1072142453 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb00005a050 con 0x7fb00c06d8d0 2024-04-01T15:22:03.938 INFO:tasks.ceph.mds.b.smithi179.stderr:2024-04-01T15:22:03.936+0000 7f4332e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-01T15:22:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.978+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb00c0afa20 con 0x7fb00c06d8d0 2024-04-01T15:22:03.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.983+0000 7fb009600640 1 -- 172.21.15.142:0/1072142453 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174140 (secure 0 0 0) 0x7fb000059950 con 0x7fb00c06d8d0 2024-04-01T15:22:03.988 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fafec06c8f0 msgr2=0x7fafec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fafec06c8f0 0x7fafec06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faff8036000 tx=0x7faff8030000 comp rx=0 tx=0).stop 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c06d8d0 msgr2=0x7fb00c072310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c06d8d0 0x7fb00c072310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb00000e960 tx=0x7fb00000ee20 comp rx=0 tx=0).stop 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 shutdown_connections 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fafec06c8f0 0x7fafec06edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb00c0b3cd0 0x7fb00c071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb00c0af030 0x7fb00c070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 --2- 172.21.15.142:0/1072142453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb00c06d8d0 0x7fb00c072310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 >> 172.21.15.142:0/1072142453 conn(0x7fb00c0b5890 msgr2=0x7fb00c06cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:03.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.988+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 shutdown_connections 2024-04-01T15:22:03.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:03.989+0000 7fb014000640 1 -- 172.21.15.142:0/1072142453 wait complete. 2024-04-01T15:22:04.009 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":898130770},{"type":"v1","addr":"172.21.15.179:6833","nonce":898130770}]},"active_addr":"172.21.15.179:6833/898130770","active_change":"2024-04-01T15:21:38.538557+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2271054828}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":210728543}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":1938819001}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":3398706126}]}]} 2024-04-01T15:22:04.013 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-01T15:22:04.013 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-01T15:22:04.013 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:22:04.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.211+0000 7fa4cfe00640 1 Processor -- start 2024-04-01T15:22:04.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.211+0000 7fa4cfe00640 1 -- start start 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.212+0000 7fa4cfe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 0x7fa4c80b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.212+0000 7fa4cfe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4c80b0f30 0x7fa4c8145b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.212+0000 7fa4cfe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa4c8146090 0x7fa4c813f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.212+0000 7fa4cfe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa4c8146520 con 0x7fa4c80b0f30 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.212+0000 7fa4cfe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa4c806f240 con 0x7fa4c8146090 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.212+0000 7fa4cfe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c8145650 con 0x7fa4c806ee60 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cca00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4c80b0f30 0x7fa4c8145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cca00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4c80b0f30 0x7fa4c8145b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59950/0 (socket says 172.21.15.142:59950) 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cca00640 1 -- 172.21.15.142:0/1236655014 learned_addr learned my addr 172.21.15.142:0/1236655014 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cd400640 1 --2- 172.21.15.142:0/1236655014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 0x7fa4c80b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cde00640 1 --2- 172.21.15.142:0/1236655014 >> v2:172.21.15.179:3300/0 conn(0x7fa4c8146090 0x7fa4c813f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cca00640 1 -- 172.21.15.142:0/1236655014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 msgr2=0x7fa4c80b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:04.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cca00640 1 --2- 172.21.15.142:0/1236655014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 0x7fa4c80b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cca00640 1 -- 172.21.15.142:0/1236655014 >> v2:172.21.15.179:3300/0 conn(0x7fa4c8146090 msgr2=0x7fa4c813f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:04.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cca00640 1 --2- 172.21.15.142:0/1236655014 >> v2:172.21.15.179:3300/0 conn(0x7fa4c8146090 0x7fa4c813f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.213+0000 7fa4cca00640 1 -- 172.21.15.142:0/1236655014 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c80b14e0 con 0x7fa4c80b0f30 2024-04-01T15:22:04.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.214+0000 7fa4cca00640 1 --2- 172.21.15.142:0/1236655014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 0x7fa4c8145b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4c806f5d0 tx=0x7fa4b402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf01a961902aed72 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:04.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.215+0000 7fa4c7e00640 1 -- 172.21.15.142:0/1236655014 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b402e070 con 0x7fa4c80b0f30 2024-04-01T15:22:04.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.215+0000 7fa4c7e00640 1 -- 172.21.15.142:0/1236655014 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b4037070 con 0x7fa4c80b0f30 2024-04-01T15:22:04.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.215+0000 7fa4c7e00640 1 -- 172.21.15.142:0/1236655014 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4031a00 con 0x7fa4c80b0f30 2024-04-01T15:22:04.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.215+0000 7fa4cfe00640 1 -- 172.21.15.142:0/1236655014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 msgr2=0x7fa4c8145b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.215+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/1236655014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 0x7fa4c8145b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4c806f5d0 tx=0x7fa4b402b880 comp rx=0 tx=0).stop 2024-04-01T15:22:04.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.216+0000 7fa4cfe00640 1 -- 172.21.15.142:0/1236655014 shutdown_connections 2024-04-01T15:22:04.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.216+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/1236655014 >> v2:172.21.15.179:3300/0 conn(0x7fa4c8146090 0x7fa4c813f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.216+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/1236655014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 0x7fa4c8145b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.216+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/1236655014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 0x7fa4c80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.216+0000 7fa4cfe00640 1 -- 172.21.15.142:0/1236655014 >> 172.21.15.142:0/1236655014 conn(0x7fa4c80bb380 msgr2=0x7fa4c80bb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:04.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.216+0000 7fa4cfe00640 1 -- 172.21.15.142:0/1236655014 shutdown_connections 2024-04-01T15:22:04.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.216+0000 7fa4cfe00640 1 -- 172.21.15.142:0/1236655014 wait complete. 2024-04-01T15:22:04.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.217+0000 7fa4cfe00640 1 Processor -- start 2024-04-01T15:22:04.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.217+0000 7fa4cfe00640 1 -- start start 2024-04-01T15:22:04.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.218+0000 7fa4cfe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 0x7fa4c80b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.218+0000 7fa4cfe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 0x7fa4c809ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.218+0000 7fa4cfe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c8146090 0x7fa4c809d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.218+0000 7fa4cfe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c813fa00 con 0x7fa4c80b0f30 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.218+0000 7fa4cfe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c813f880 con 0x7fa4c8146090 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.218+0000 7fa4cfe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c813fb80 con 0x7fa4c806ee60 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.218+0000 7fa4cca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 0x7fa4c809ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.218+0000 7fa4cca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 0x7fa4c809ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59962/0 (socket says 172.21.15.142:59962) 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.218+0000 7fa4cca00640 1 -- 172.21.15.142:0/2165385226 learned_addr learned my addr 172.21.15.142:0/2165385226 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cd400640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 0x7fa4c80b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cde00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c8146090 0x7fa4c809d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cca00640 1 -- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 msgr2=0x7fa4c80b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cca00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 0x7fa4c80b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cca00640 1 -- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c8146090 msgr2=0x7fa4c809d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cca00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c8146090 0x7fa4c809d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cca00640 1 -- 172.21.15.142:0/2165385226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c809f190 con 0x7fa4c80b0f30 2024-04-01T15:22:04.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cde00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c8146090 0x7fa4c809d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:04.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cca00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 0x7fa4c809ded0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4000c00 tx=0x7fa4b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:04.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4c5600640 1 -- 172.21.15.142:0/2165385226 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4032880 con 0x7fa4c80b0f30 2024-04-01T15:22:04.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4c5600640 1 -- 172.21.15.142:0/2165385226 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b4032a20 con 0x7fa4c80b0f30 2024-04-01T15:22:04.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4c5600640 1 -- 172.21.15.142:0/2165385226 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4032e10 con 0x7fa4c80b0f30 2024-04-01T15:22:04.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c80b40e0 con 0x7fa4c80b0f30 2024-04-01T15:22:04.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.219+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c80b5130 con 0x7fa4c80b0f30 2024-04-01T15:22:04.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.220+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c80b3ed0 con 0x7fa4c80b0f30 2024-04-01T15:22:04.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.221+0000 7fa4c5600640 1 -- 172.21.15.142:0/2165385226 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4b404c060 con 0x7fa4c80b0f30 2024-04-01T15:22:04.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.222+0000 7fa4c5600640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa4a806c8f0 0x7fa4a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.222+0000 7fa4c5600640 1 -- 172.21.15.142:0/2165385226 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa4b40ad770 con 0x7fa4c80b0f30 2024-04-01T15:22:04.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.223+0000 7fa4cd400640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa4a806c8f0 0x7fa4a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.224+0000 7fa4cd400640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa4a806c8f0 0x7fa4a806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc007330 tx=0x7fa4bc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:04.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.227+0000 7fa4c5600640 1 -- 172.21.15.142:0/2165385226 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa4b4040070 con 0x7fa4c80b0f30 2024-04-01T15:22:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.425+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4c8068710 con 0x7fa4c80b0f30 2024-04-01T15:22:04.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.428+0000 7fa4c5600640 1 -- 172.21.15.142:0/2165385226 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fa4b407bc20 con 0x7fa4c80b0f30 2024-04-01T15:22:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:04.430 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":20,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:59.509664+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa4a806c8f0 msgr2=0x7fa4a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa4a806c8f0 0x7fa4a806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc007330 tx=0x7fa4bc00b040 comp rx=0 tx=0).stop 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 msgr2=0x7fa4c809ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 0x7fa4c809ded0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4000c00 tx=0x7fa4b40046c0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 shutdown_connections 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa4a806c8f0 0x7fa4a806edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c8146090 0x7fa4c809d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c80b0f30 0x7fa4c809ded0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 --2- 172.21.15.142:0/2165385226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c806ee60 0x7fa4c80b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 >> 172.21.15.142:0/2165385226 conn(0x7fa4c80bb380 msgr2=0x7fa4c81435c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 shutdown_connections 2024-04-01T15:22:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.431+0000 7fa4cfe00640 1 -- 172.21.15.142:0/2165385226 wait complete. 2024-04-01T15:22:04.451 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-01T15:22:04.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:22:04.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.650+0000 7f26ebe00640 1 Processor -- start 2024-04-01T15:22:04.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.650+0000 7f26ebe00640 1 -- start start 2024-04-01T15:22:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26ebe00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f26e40aefa0 0x7f26e40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26ebe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40b0290 0x7f26e40b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26ebe00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e406dcb0 con 0x7f26e406d8d0 2024-04-01T15:22:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26ebe00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f26e40b1790 con 0x7f26e40aefa0 2024-04-01T15:22:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26ebe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f26e40b14b0 con 0x7f26e40b0290 2024-04-01T15:22:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26e9400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f26e406d8d0 0x7f26e40ae890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54486/0 (socket says 172.21.15.142:54486) 2024-04-01T15:22:04.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26e9400640 1 -- 172.21.15.142:0/654710643 learned_addr learned my addr 172.21.15.142:0/654710643 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26e8a00640 1 --2- 172.21.15.142:0/654710643 >> v2:172.21.15.179:3300/0 conn(0x7f26e40aefa0 0x7f26e40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289897253 0 0) 0x7f26e406dcb0 con 0x7f26e406d8d0 2024-04-01T15:22:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26e9e00640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40b0290 0x7f26e40b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.652+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26cc005730 con 0x7f26e406d8d0 2024-04-01T15:22:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3355374135 0 0) 0x7f26cc005730 con 0x7f26e406d8d0 2024-04-01T15:22:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40b0290 msgr2=0x7f26e40b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40b0290 0x7f26e40b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 >> v2:172.21.15.179:3300/0 conn(0x7f26e40aefa0 msgr2=0x7f26e40b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 --2- 172.21.15.142:0/654710643 >> v2:172.21.15.179:3300/0 conn(0x7f26e40aefa0 0x7f26e40b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e40b53b0 con 0x7f26e406d8d0 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f26d8001670 con 0x7f26e406d8d0 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 >> v1:172.21.15.142:6789/0 conn(0x7f26e406d8d0 legacy=0x7f26e40ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26cc005bc0 0x7f26cc005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc006a10 0x7f26cc006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40b0290 0x7f26cc0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f26e40b1790 con 0x7f26cc005bc0 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26e40b14b0 con 0x7f26cc006a10 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f26cc00dbd0 con 0x7f26e40b0290 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e9400640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26cc005bc0 0x7f26cc005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e8a00640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc006a10 0x7f26cc006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e9e00640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40b0290 0x7f26cc0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e9400640 1 -- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40b0290 msgr2=0x7f26cc0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e9400640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40b0290 0x7f26cc0073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.653+0000 7f26e9400640 1 -- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc006a10 msgr2=0x7f26cc006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:04.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.654+0000 7f26e9400640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc006a10 0x7f26cc006e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.654+0000 7f26e9400640 1 -- 172.21.15.142:0/654710643 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc005730 con 0x7f26cc005bc0 2024-04-01T15:22:04.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.654+0000 7f26e9e00640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40b0290 0x7f26cc0073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:04.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.655+0000 7f26e9400640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26cc005bc0 0x7f26cc005fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c290 tx=0x7f26cc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd8597556515cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:04.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.655+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8007d50 con 0x7f26cc005bc0 2024-04-01T15:22:04.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.655+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d8030070 con 0x7f26cc005bc0 2024-04-01T15:22:04.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.655+0000 7f26e3e00640 1 -- 172.21.15.142:0/654710643 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d802cd80 con 0x7f26cc005bc0 2024-04-01T15:22:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.655+0000 7f26ebe00640 1 -- 172.21.15.142:0/654710643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26cc005bc0 msgr2=0x7f26cc005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.655+0000 7f26ebe00640 1 --2- 172.21.15.142:0/654710643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26cc005bc0 0x7f26cc005fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c290 tx=0x7f26cc007a40 comp rx=0 tx=0).stop 2024-04-01T15:22:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.655+0000 7f26e9e00640 1 -- 172.21.15.142:0/654710643 reap_dead start 2024-04-01T15:22:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.655+0000 7f26ebe00640 1 -- 172.21.15.142:0/654710643 shutdown_connections 2024-04-01T15:22:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.655+0000 7f26ebe00640 1 -- 172.21.15.142:0/654710643 >> 172.21.15.142:0/654710643 conn(0x7f26e40b5890 msgr2=0x7f26e40b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.656+0000 7f26ebe00640 1 -- 172.21.15.142:0/654710643 shutdown_connections 2024-04-01T15:22:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.656+0000 7f26ebe00640 1 -- 172.21.15.142:0/654710643 wait complete. 2024-04-01T15:22:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.657+0000 7f26ebe00640 1 Processor -- start 2024-04-01T15:22:04.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.657+0000 7f26ebe00640 1 -- start start 2024-04-01T15:22:04.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.658+0000 7f26ebe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc005bc0 0x7f26e41d2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.658+0000 7f26ebe00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e409c2f0 0x7f26e409c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.658+0000 7f26ebe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e41cc4b0 0x7f26e41cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.658+0000 7f26ebe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f26e40ae370 con 0x7f26e41cc4b0 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.658+0000 7f26ebe00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26e40ae090 con 0x7f26cc005bc0 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.658+0000 7f26ebe00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f26e40b2160 con 0x7f26e409c2f0 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.658+0000 7f26e9e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e41cc4b0 0x7f26e41cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e41cc4b0 0x7f26e41cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59972/0 (socket says 172.21.15.142:59972) 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9e00640 1 -- 172.21.15.142:0/3849319686 learned_addr learned my addr 172.21.15.142:0/3849319686 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e8a00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e409c2f0 0x7f26e409c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9400640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc005bc0 0x7f26e41d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9e00640 1 -- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e409c2f0 msgr2=0x7f26e409c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9e00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e409c2f0 0x7f26e409c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9e00640 1 -- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc005bc0 msgr2=0x7f26e41d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9e00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc005bc0 0x7f26e41d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9e00640 1 -- 172.21.15.142:0/3849319686 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e409be40 con 0x7f26e41cc4b0 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9400640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc005bc0 0x7f26e41d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e9e00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e41cc4b0 0x7f26e41cc930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f26e4072fd0 tx=0x7f26dc00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:04.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e1600640 1 -- 172.21.15.142:0/3849319686 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc01c070 con 0x7f26e41cc4b0 2024-04-01T15:22:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26e1600640 1 -- 172.21.15.142:0/3849319686 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26dc017400 con 0x7f26e41cc4b0 2024-04-01T15:22:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.659+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e409d7c0 con 0x7f26e41cc4b0 2024-04-01T15:22:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.660+0000 7f26e1600640 1 -- 172.21.15.142:0/3849319686 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0177d0 con 0x7f26e41cc4b0 2024-04-01T15:22:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.660+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e41d2ae0 con 0x7f26e41cc4b0 2024-04-01T15:22:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.661+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e4068710 con 0x7f26e41cc4b0 2024-04-01T15:22:04.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.662+0000 7f26e1600640 1 -- 172.21.15.142:0/3849319686 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f26dc005d10 con 0x7f26e41cc4b0 2024-04-01T15:22:04.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.663+0000 7f26e1600640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f26c406c920 0x7f26c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:04.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.663+0000 7f26e1600640 1 -- 172.21.15.142:0/3849319686 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f26dc08be70 con 0x7f26e41cc4b0 2024-04-01T15:22:04.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.664+0000 7f26e9400640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f26c406c920 0x7f26c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:04.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.665+0000 7f26e9400640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f26c406c920 0x7f26c406ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26d8034000 tx=0x7f26d8007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:04.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.668+0000 7f26e1600640 1 -- 172.21.15.142:0/3849319686 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f26dc012070 con 0x7f26e41cc4b0 2024-04-01T15:22:04.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.867+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26e409d530 con 0x7f26e41cc4b0 2024-04-01T15:22:04.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.869+0000 7f26e1600640 1 -- 172.21.15.142:0/3849319686 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7f26dc05a290 con 0x7f26e41cc4b0 2024-04-01T15:22:04.871 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:04.872 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":20,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:59.509664+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f26c406c920 msgr2=0x7f26c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f26c406c920 0x7f26c406ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26d8034000 tx=0x7f26d8007000 comp rx=0 tx=0).stop 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e41cc4b0 msgr2=0x7f26e41cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e41cc4b0 0x7f26e41cc930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f26e4072fd0 tx=0x7f26dc00f4a0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 shutdown_connections 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f26c406c920 0x7f26c406ede0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e41cc4b0 0x7f26e41cc930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e409c2f0 0x7f26e409c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 --2- 172.21.15.142:0/3849319686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc005bc0 0x7f26e41d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 >> 172.21.15.142:0/3849319686 conn(0x7f26e40b5890 msgr2=0x7f26e4067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 shutdown_connections 2024-04-01T15:22:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:04.872+0000 7f26ebe00640 1 -- 172.21.15.142:0/3849319686 wait complete. 2024-04-01T15:22:04.892 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-01T15:22:04.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-01T15:22:04.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-01T15:22:04.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-01T15:22:04.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-01T15:22:04.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-01T15:22:04.895 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-01T15:22:04.895 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-01T15:22:05.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.185+0000 7f6c3d800640 1 Processor -- start 2024-04-01T15:22:05.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.185+0000 7f6c3d800640 1 -- start start 2024-04-01T15:22:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.187+0000 7fd79a800640 1 Processor -- start 2024-04-01T15:22:05.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.187+0000 7f6c3d800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c3814d600 0x7f6c3814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.187+0000 7f6c3d800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c380b45a0 con 0x7f6c380b41c0 2024-04-01T15:22:05.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.187+0000 7f6c3d800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c380b5220 con 0x7f6c38143e40 2024-04-01T15:22:05.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.187+0000 7f6c3d800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f6c3813e540 con 0x7f6c3814d600 2024-04-01T15:22:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.188+0000 7f6c37400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c3814d600 0x7f6c3814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.188+0000 7f6c37400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c3814d600 0x7f6c3814f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:56780/0 (socket says 172.21.15.142:56780) 2024-04-01T15:22:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.188+0000 7f6c37400640 1 -- 172.21.15.142:0/2646590228 learned_addr learned my addr 172.21.15.142:0/2646590228 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.188+0000 7f6c36000640 1 --1- 172.21.15.142:0/2646590228 >> v1:172.21.15.179:6789/0 conn(0x7f6c38143e40 0x7f6c381442a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.142:34332/0 (socket says 172.21.15.142:34332) 2024-04-01T15:22:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.187+0000 7fd79a800640 1 -- start start 2024-04-01T15:22:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.189+0000 7fd79a800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7940ba280 0x7fd7940b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.189+0000 7fd79a800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7940ba660 con 0x7fd7940b5940 2024-04-01T15:22:05.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.189+0000 7fd79a800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7940b4420 con 0x7fd794147730 2024-04-01T15:22:05.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.189+0000 7fd79a800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd7940b4700 con 0x7fd7940ba280 2024-04-01T15:22:05.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.189+0000 7f6c35600640 1 -- 172.21.15.142:0/2646590228 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029422153 0 0) 0x7f6c380b45a0 con 0x7f6c380b41c0 2024-04-01T15:22:05.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.189+0000 7f6c35600640 1 -- 172.21.15.142:0/2646590228 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c1c003520 con 0x7f6c380b41c0 2024-04-01T15:22:05.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.190+0000 7f6c37400640 1 -- 172.21.15.142:0/2646590228 >> v1:172.21.15.179:6789/0 conn(0x7f6c38143e40 legacy=0x7f6c381442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.190+0000 7f6c37400640 1 -- 172.21.15.142:0/2646590228 >> v1:172.21.15.142:6789/0 conn(0x7f6c380b41c0 legacy=0x7f6c3813de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.190+0000 7f6c37400640 1 -- 172.21.15.142:0/2646590228 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c380b5500 con 0x7f6c3814d600 2024-04-01T15:22:05.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.190+0000 7fd799400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7940ba280 0x7fd7940b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.190+0000 7fd798a00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd7940b5940 0x7fd794141390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44242/0 (socket says 172.21.15.142:44242) 2024-04-01T15:22:05.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.190+0000 7fd798a00640 1 -- 172.21.15.142:0/1418036493 learned_addr learned my addr 172.21.15.142:0/1418036493 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:05.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.190+0000 7f09d2c00640 1 Processor -- start 2024-04-01T15:22:05.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.191+0000 7fd793e00640 1 -- 172.21.15.142:0/1418036493 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117570569 0 0) 0x7fd7940ba660 con 0x7fd7940b5940 2024-04-01T15:22:05.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.191+0000 7f24c3200640 1 Processor -- start 2024-04-01T15:22:05.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7f24c3200640 1 -- start start 2024-04-01T15:22:05.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7fd793e00640 1 -- 172.21.15.142:0/1418036493 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77c003520 con 0x7fd7940b5940 2024-04-01T15:22:05.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.191+0000 7f09d2c00640 1 -- start start 2024-04-01T15:22:05.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7f09d2c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09c403a3d0 0x7f09c40c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7f09d2c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c40c6960 0x7f09c40d7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7f09d2c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c40cce90 con 0x7f09c4038880 2024-04-01T15:22:05.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7f09d2c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f09c403acd0 con 0x7f09c403a3d0 2024-04-01T15:22:05.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7f09d2c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f09c40395b0 con 0x7f09c40c6960 2024-04-01T15:22:05.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7fd793e00640 1 -- 172.21.15.142:0/1418036493 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100623809 0 0) 0x7fd7940b4420 con 0x7fd794147730 2024-04-01T15:22:05.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7f6c37400640 1 --2- 172.21.15.142:0/2646590228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c3814d600 0x7f6c3814f9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000bf60 tx=0x7f6c30030380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f739b21d7cd664c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7f09d1800640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f09c4038880 0x7f09c40cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.142:34342/0 (socket says 172.21.15.142:34342) 2024-04-01T15:22:05.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.192+0000 7f09d1800640 1 -- 172.21.15.142:0/1007841447 learned_addr learned my addr 172.21.15.142:0/1007841447 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:05.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7f09d2200640 1 --2- 172.21.15.142:0/1007841447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c40c6960 0x7f09c40d7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7f09d0e00640 1 --2- 172.21.15.142:0/1007841447 >> v2:172.21.15.142:3300/0 conn(0x7f09c403a3d0 0x7f09c40c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7fd793e00640 1 -- 172.21.15.142:0/1418036493 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7940ba660 con 0x7fd794147730 2024-04-01T15:22:05.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7fd793e00640 1 -- 172.21.15.142:0/1418036493 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3886941637 0 0) 0x7fd77c003520 con 0x7fd7940b5940 2024-04-01T15:22:05.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7fd799400640 1 -- 172.21.15.142:0/1418036493 >> v1:172.21.15.179:6789/0 conn(0x7fd794147730 legacy=0x7fd794147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7fd799400640 1 -- 172.21.15.142:0/1418036493 >> v1:172.21.15.142:6789/0 conn(0x7fd7940b5940 legacy=0x7fd794141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7fd799400640 1 -- 172.21.15.142:0/1418036493 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7940b49e0 con 0x7fd7940ba280 2024-04-01T15:22:05.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7f24c3200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24bc0ca690 0x7f24bc0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7f24c3200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f24bc0d1180 0x7f24bc0d1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7f24c3200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24bc035430 con 0x7f24bc036b60 2024-04-01T15:22:05.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f24c1e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f24bc036b60 0x7f24bc0d4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44246/0 (socket says 172.21.15.142:44246) 2024-04-01T15:22:05.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f24c1e00640 1 -- 172.21.15.142:0/3491014400 learned_addr learned my addr 172.21.15.142:0/3491014400 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:05.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f24c3200640 1 -- 172.21.15.142:0/3491014400 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f24bc0d0cf0 con 0x7f24bc0ca690 2024-04-01T15:22:05.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f24c3200640 1 -- 172.21.15.142:0/3491014400 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f24bc038380 con 0x7f24bc0d1180 2024-04-01T15:22:05.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f24c1400640 1 --2- 172.21.15.142:0/3491014400 >> v2:172.21.15.142:3300/0 conn(0x7f24bc0ca690 0x7f24bc0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f24c2800640 1 --2- 172.21.15.142:0/3491014400 >> v2:172.21.15.179:3300/0 conn(0x7f24bc0d1180 0x7f24bc0d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1219756161 0 0) 0x7f24bc035430 con 0x7f24bc036b60 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24a8003520 con 0x7f24bc036b60 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3850689331 0 0) 0x7f24a8003520 con 0x7f24bc036b60 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 >> v2:172.21.15.179:3300/0 conn(0x7f24bc0d1180 msgr2=0x7f24bc0d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 --2- 172.21.15.142:0/3491014400 >> v2:172.21.15.179:3300/0 conn(0x7f24bc0d1180 0x7f24bc0d1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 >> v2:172.21.15.142:3300/0 conn(0x7f24bc0ca690 msgr2=0x7f24bc0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 --2- 172.21.15.142:0/3491014400 >> v2:172.21.15.142:3300/0 conn(0x7f24bc0ca690 0x7f24bc0cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc036f40 con 0x7f24bc036b60 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f24b4001670 con 0x7f24bc036b60 2024-04-01T15:22:05.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.193+0000 7f09d2200640 1 -- 172.21.15.142:0/1007841447 >> v2:172.21.15.142:3300/0 conn(0x7f09c403a3d0 msgr2=0x7f09c40c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 >> v1:172.21.15.142:6789/0 conn(0x7f24bc036b60 legacy=0x7f24bc0d4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f09cbe00640 1 -- 172.21.15.142:0/1007841447 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261207616 0 0) 0x7f09c40cce90 con 0x7f09c4038880 2024-04-01T15:22:05.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 0x7f24a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8004800 0x7f24a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a8005230 0x7f24a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc0d0cf0 con 0x7f24a8004800 2024-04-01T15:22:05.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc038380 con 0x7f24a8005230 2024-04-01T15:22:05.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24a800c210 con 0x7f24a80039b0 2024-04-01T15:22:05.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7fd799400640 1 --2- 172.21.15.142:0/1418036493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940ba280 0x7fd7940b5400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7880097a0 tx=0x7fd78802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3d6fbd8ff10557 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7fd793e00640 1 -- 172.21.15.142:0/1418036493 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788038070 con 0x7fd7940ba280 2024-04-01T15:22:05.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7fd793e00640 1 -- 172.21.15.142:0/1418036493 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd788031500 con 0x7fd7940ba280 2024-04-01T15:22:05.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7fd793e00640 1 -- 172.21.15.142:0/1418036493 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780001670 con 0x7fd7940ba280 2024-04-01T15:22:05.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f09d2200640 1 --2- 172.21.15.142:0/1007841447 >> v2:172.21.15.142:3300/0 conn(0x7f09c403a3d0 0x7f09c40c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f09d2200640 1 -- 172.21.15.142:0/1007841447 >> v1:172.21.15.179:6789/0 conn(0x7f09c4038880 legacy=0x7f09c40cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.194+0000 7f09d2200640 1 -- 172.21.15.142:0/1007841447 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c4038c60 con 0x7f09c40c6960 2024-04-01T15:22:05.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.195+0000 7f09d0e00640 1 --2- 172.21.15.142:0/1007841447 >> v2:172.21.15.142:3300/0 conn(0x7f09c403a3d0 0x7f09c40c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:05.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7f24c1400640 1 --2- 172.21.15.142:0/3491014400 >> v2:172.21.15.142:3300/0 conn(0x7f24bc0ca690 0x7f24bc0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:22:05.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7f24c1e00640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 0x7f24a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7f6c35600640 1 -- 172.21.15.142:0/2646590228 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3003e070 con 0x7f6c3814d600 2024-04-01T15:22:05.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7f260b200640 1 Processor -- start 2024-04-01T15:22:05.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7f6c35600640 1 -- 172.21.15.142:0/2646590228 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c30036480 con 0x7f6c3814d600 2024-04-01T15:22:05.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7f6c35600640 1 -- 172.21.15.142:0/2646590228 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30036850 con 0x7f6c3814d600 2024-04-01T15:22:05.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.196+0000 7f24c2800640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a8005230 0x7f24a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7f24c1e00640 1 -- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a8005230 msgr2=0x7f24a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7fd79a800640 1 -- 172.21.15.142:0/1418036493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940ba280 msgr2=0x7fd7940b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7fd79a800640 1 --2- 172.21.15.142:0/1418036493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940ba280 0x7fd7940b5400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7880097a0 tx=0x7fd78802b820 comp rx=0 tx=0).stop 2024-04-01T15:22:05.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7f24c1e00640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a8005230 0x7f24a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7f24c1e00640 1 -- 172.21.15.142:0/3491014400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8004800 msgr2=0x7f24a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7f24c1e00640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8004800 0x7f24a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7f24c1e00640 1 -- 172.21.15.142:0/3491014400 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc036f40 con 0x7f24a80039b0 2024-04-01T15:22:05.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7f260b200640 1 -- start start 2024-04-01T15:22:05.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7f24c2800640 1 -- 172.21.15.142:0/3491014400 reap_dead start 2024-04-01T15:22:05.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7f6c3d800640 1 -- 172.21.15.142:0/2646590228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c3814d600 msgr2=0x7f6c3814f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7f6c3d800640 1 --2- 172.21.15.142:0/2646590228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c3814d600 0x7f6c3814f9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000bf60 tx=0x7f6c30030380 comp rx=0 tx=0).stop 2024-04-01T15:22:05.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7fd79a800640 1 -- 172.21.15.142:0/1418036493 shutdown_connections 2024-04-01T15:22:05.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7fd79a800640 1 --2- 172.21.15.142:0/1418036493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940ba280 0x7fd7940b5400 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.197+0000 7fd79a800640 1 -- 172.21.15.142:0/1418036493 >> 172.21.15.142:0/1418036493 conn(0x7fd7940bd4b0 msgr2=0x7fd7940b9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7f09d2200640 1 --2- 172.21.15.142:0/1007841447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c40c6960 0x7f09c40d7020 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f09b80097a0 tx=0x7f09b802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6beea55e519cdfc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7f6c3d800640 1 -- 172.21.15.142:0/2646590228 shutdown_connections 2024-04-01T15:22:05.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7fd79a800640 1 -- 172.21.15.142:0/1418036493 shutdown_connections 2024-04-01T15:22:05.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7f6c3d800640 1 --2- 172.21.15.142:0/2646590228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c3814d600 0x7f6c3814f9f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7f6c3d800640 1 -- 172.21.15.142:0/2646590228 >> 172.21.15.142:0/2646590228 conn(0x7f6c3809b300 msgr2=0x7f6c3809b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7f6c3d800640 1 -- 172.21.15.142:0/2646590228 shutdown_connections 2024-04-01T15:22:05.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7fd79a800640 1 -- 172.21.15.142:0/1418036493 wait complete. 2024-04-01T15:22:05.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7f09cbe00640 1 -- 172.21.15.142:0/1007841447 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8035020 con 0x7f09c40c6960 2024-04-01T15:22:05.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7f09cbe00640 1 -- 172.21.15.142:0/1007841447 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b8031830 con 0x7f09c40c6960 2024-04-01T15:22:05.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7f09cbe00640 1 -- 172.21.15.142:0/1007841447 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8031c00 con 0x7f09c40c6960 2024-04-01T15:22:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.198+0000 7f260b200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f260406b790 0x7f26040bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f260b200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 0x7f26041484b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f260b200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f260406bb70 con 0x7f26040b7f00 2024-04-01T15:22:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f260b200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f26041479f0 con 0x7f260406b790 2024-04-01T15:22:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f260b200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2604147cb0 con 0x7f2604141ea0 2024-04-01T15:22:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f09d2c00640 1 -- 172.21.15.142:0/1007841447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c40c6960 msgr2=0x7f09c40d7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f09d2c00640 1 --2- 172.21.15.142:0/1007841447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c40c6960 0x7f09c40d7020 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f09b80097a0 tx=0x7f09b802b8d0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f2603400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f26040b7f00 0x7f2604141790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44260/0 (socket says 172.21.15.142:44260) 2024-04-01T15:22:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f2603400640 1 -- 172.21.15.142:0/3790462764 learned_addr learned my addr 172.21.15.142:0/3790462764 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f2603e00640 1 --2- 172.21.15.142:0/3790462764 >> v2:172.21.15.142:3300/0 conn(0x7f260406b790 0x7f26040bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f2609200640 1 --2- 172.21.15.142:0/3790462764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 0x7f26041484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f24c1e00640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 0x7f24a8003dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24b400c290 tx=0x7f24a8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81eade533dab0dcc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4007d70 con 0x7f24a80039b0 2024-04-01T15:22:05.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f24c0a00640 1 -- 172.21.15.142:0/3491014400 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b4030070 con 0x7f24a80039b0 2024-04-01T15:22:05.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f2603e00640 1 -- 172.21.15.142:0/3790462764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 msgr2=0x7f26041484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f24c3200640 1 -- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 msgr2=0x7f24a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f24c3200640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 0x7f24a8003dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24b400c290 tx=0x7f24a8005830 comp rx=0 tx=0).stop 2024-04-01T15:22:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f09d2c00640 1 -- 172.21.15.142:0/1007841447 shutdown_connections 2024-04-01T15:22:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.201+0000 7f09d2c00640 1 --2- 172.21.15.142:0/1007841447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c40c6960 0x7f09c40d7020 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.201+0000 7f09d2c00640 1 --2- 172.21.15.142:0/1007841447 >> v2:172.21.15.142:3300/0 conn(0x7f09c403a3d0 0x7f09c40c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.201+0000 7f09d2c00640 1 -- 172.21.15.142:0/1007841447 >> 172.21.15.142:0/1007841447 conn(0x7f09c403ea70 msgr2=0x7f09c403ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f2603e00640 1 --2- 172.21.15.142:0/3790462764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 0x7f26041484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f2603e00640 1 -- 172.21.15.142:0/3790462764 >> v1:172.21.15.142:6789/0 conn(0x7f26040b7f00 legacy=0x7f2604141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f2603e00640 1 -- 172.21.15.142:0/3790462764 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2604147f90 con 0x7f260406b790 2024-04-01T15:22:05.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7fd79a800640 1 Processor -- start 2024-04-01T15:22:05.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.201+0000 7f24c3200640 1 -- 172.21.15.142:0/3491014400 shutdown_connections 2024-04-01T15:22:05.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.201+0000 7f24c3200640 1 --2- 172.21.15.142:0/3491014400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 0x7f24a8003dd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.201+0000 7f24c3200640 1 -- 172.21.15.142:0/3491014400 >> 172.21.15.142:0/3491014400 conn(0x7f24bc03abf0 msgr2=0x7f24bc005e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.201+0000 7fd79a800640 1 -- start start 2024-04-01T15:22:05.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.200+0000 7f3bb9a00640 1 Processor -- start 2024-04-01T15:22:05.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.201+0000 7f3bb9a00640 1 -- start start 2024-04-01T15:22:05.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.199+0000 7f6c3d800640 1 -- 172.21.15.142:0/2646590228 wait complete. 2024-04-01T15:22:05.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f6c3d800640 1 Processor -- start 2024-04-01T15:22:05.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f24c3200640 1 -- 172.21.15.142:0/3491014400 shutdown_connections 2024-04-01T15:22:05.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f24c3200640 1 -- 172.21.15.142:0/3491014400 wait complete. 2024-04-01T15:22:05.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f6c3d800640 1 -- start start 2024-04-01T15:22:05.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f2603e00640 1 --2- 172.21.15.142:0/3790462764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260406b790 0x7f26040bae80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25f40097a0 tx=0x7f25f402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45db6911f831e375 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f3bb9a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4146ec0 0x7f3bb406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f09d2c00640 1 -- 172.21.15.142:0/1007841447 shutdown_connections 2024-04-01T15:22:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.203+0000 7f09d2c00640 1 -- 172.21.15.142:0/1007841447 wait complete. 2024-04-01T15:22:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.203+0000 7f2602a00640 1 -- 172.21.15.142:0/3790462764 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4035020 con 0x7f260406b790 2024-04-01T15:22:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.203+0000 7f2602a00640 1 -- 172.21.15.142:0/3790462764 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4031810 con 0x7f260406b790 2024-04-01T15:22:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.203+0000 7f2602a00640 1 -- 172.21.15.142:0/3790462764 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4031be0 con 0x7f260406b790 2024-04-01T15:22:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f3bb9a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bb40b55d0 con 0x7f3bb406df60 2024-04-01T15:22:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f3bb9a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bb40b07c0 con 0x7f3bb414c1e0 2024-04-01T15:22:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.202+0000 7f3bb9a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb40b0aa0 con 0x7f3bb4146ec0 2024-04-01T15:22:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.203+0000 7f3bb2a00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3bb406df60 0x7f3bb40af400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44268/0 (socket says 172.21.15.142:44268) 2024-04-01T15:22:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.203+0000 7f3bb2a00640 1 -- 172.21.15.142:0/1285693986 learned_addr learned my addr 172.21.15.142:0/1285693986 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.203+0000 7f3bb2000640 1 --2- 172.21.15.142:0/1285693986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4146ec0 0x7f3bb406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f3bb1600640 1 -- 172.21.15.142:0/1285693986 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703893380 0 0) 0x7f3bb40b55d0 con 0x7f3bb406df60 2024-04-01T15:22:05.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f3bb1600640 1 -- 172.21.15.142:0/1285693986 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b98003520 con 0x7f3bb406df60 2024-04-01T15:22:05.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f6c3d800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c380b41c0 0x7f6c381dcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f3bb1600640 1 -- 172.21.15.142:0/1285693986 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79430674 0 0) 0x7f3bb40b07c0 con 0x7f3bb414c1e0 2024-04-01T15:22:05.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f3bb2000640 1 -- 172.21.15.142:0/1285693986 >> v1:172.21.15.179:6789/0 conn(0x7f3bb414c1e0 legacy=0x7f3bb414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f3bb2000640 1 -- 172.21.15.142:0/1285693986 >> v1:172.21.15.142:6789/0 conn(0x7f3bb406df60 legacy=0x7f3bb40af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f3bb2000640 1 -- 172.21.15.142:0/1285693986 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb40aeee0 con 0x7f3bb4146ec0 2024-04-01T15:22:05.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f260b200640 1 -- 172.21.15.142:0/3790462764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260406b790 msgr2=0x7f26040bae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f260b200640 1 --2- 172.21.15.142:0/3790462764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260406b790 0x7f26040bae80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25f40097a0 tx=0x7f25f402b8b0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.203+0000 7f24c3200640 1 Processor -- start 2024-04-01T15:22:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f260b200640 1 -- 172.21.15.142:0/3790462764 shutdown_connections 2024-04-01T15:22:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f260b200640 1 --2- 172.21.15.142:0/3790462764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 0x7f26041484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f260b200640 1 --2- 172.21.15.142:0/3790462764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260406b790 0x7f26040bae80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f260b200640 1 -- 172.21.15.142:0/3790462764 >> 172.21.15.142:0/3790462764 conn(0x7f26040b9b40 msgr2=0x7f26040b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f6c3d800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c38143e40 0x7f6c3813edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f6c3d800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c3814d600 0x7f6c381343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f6c3d800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c380b4c60 con 0x7f6c38143e40 2024-04-01T15:22:05.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f6c3d800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c380aee40 con 0x7f6c3814d600 2024-04-01T15:22:05.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f6c3d800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c380b05e0 con 0x7f6c380b41c0 2024-04-01T15:22:05.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f09d2c00640 1 Processor -- start 2024-04-01T15:22:05.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f09d2c00640 1 -- start start 2024-04-01T15:22:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.204+0000 7f6c36a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c380b41c0 0x7f6c381dcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f6c36a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c380b41c0 0x7f6c381dcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50224/0 (socket says 172.21.15.142:50224) 2024-04-01T15:22:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f6c36a00640 1 -- 172.21.15.142:0/885911133 learned_addr learned my addr 172.21.15.142:0/885911133 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f6c37400640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c3814d600 0x7f6c381343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.205+0000 7f24c3200640 1 -- start start 2024-04-01T15:22:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f24c3200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 0x7f24bc0a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f24c3200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24bc034170 0x7f24bc0a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f24c3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc0a5b80 0x7f24bc16b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f24c3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc034e00 con 0x7f24bc0a5b80 2024-04-01T15:22:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f24c3200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc0d4c90 con 0x7f24bc034170 2024-04-01T15:22:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f24c3200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24bc034f80 con 0x7f24a80039b0 2024-04-01T15:22:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f260b200640 1 -- 172.21.15.142:0/3790462764 shutdown_connections 2024-04-01T15:22:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f6c36000640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c38143e40 0x7f6c3813edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f3bb2000640 1 --2- 172.21.15.142:0/1285693986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4146ec0 0x7f3bb406d8d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00097d0 tx=0x7f3ba002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6c68de4f003fbde server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f260b200640 1 -- 172.21.15.142:0/3790462764 wait complete. 2024-04-01T15:22:05.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7fd79a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940b5940 0x7fd79414ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.206+0000 7f24c2800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc0a5b80 0x7f24bc16b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f09d2c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c4038880 0x7f09c40cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f09d2c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c403a3d0 0x7f09c40c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f09d2c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40c6960 0x7f09c40c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f09d2c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f09c403a810 con 0x7f09c4038880 2024-04-01T15:22:05.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f09d2c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4039850 con 0x7f09c40c6960 2024-04-01T15:22:05.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f09d2c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f09c40c6df0 con 0x7f09c403a3d0 2024-04-01T15:22:05.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7fd79a800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940ba280 0x7fd79413e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f6c37400640 1 -- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c380b41c0 msgr2=0x7f6c381dcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f6c37400640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c380b41c0 0x7f6c381dcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f6c37400640 1 -- 172.21.15.142:0/885911133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c38143e40 msgr2=0x7f6c3813edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f24c1400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24bc034170 0x7f24bc0a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f24c2800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc0a5b80 0x7f24bc16b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51054/0 (socket says 172.21.15.142:51054) 2024-04-01T15:22:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f24c2800640 1 -- 172.21.15.142:0/3075704981 learned_addr learned my addr 172.21.15.142:0/3075704981 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f6c37400640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c38143e40 0x7f6c3813edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f6c37400640 1 -- 172.21.15.142:0/885911133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c38070e80 con 0x7f6c3814d600 2024-04-01T15:22:05.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f09d0e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c403a3d0 0x7f09c40c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f24c1e00640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 0x7f24bc0a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f24c2800640 1 -- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 msgr2=0x7f24bc0a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f24c2800640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80039b0 0x7f24bc0a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f24c2800640 1 -- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24bc034170 msgr2=0x7f24bc0a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f24c2800640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24bc034170 0x7f24bc0a5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f24c2800640 1 -- 172.21.15.142:0/3075704981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc0aa540 con 0x7f24bc0a5b80 2024-04-01T15:22:05.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7fd79a800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd794147730 0x7fd794141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7fd79a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd794141c20 con 0x7fd7940b5940 2024-04-01T15:22:05.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7fd79a800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd794141aa0 con 0x7fd794147730 2024-04-01T15:22:05.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7fd79a800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd794152ea0 con 0x7fd7940ba280 2024-04-01T15:22:05.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7fd799400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940b5940 0x7fd79414ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7fd798a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940ba280 0x7fd79413e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7fd799400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940b5940 0x7fd79414ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51068/0 (socket says 172.21.15.142:51068) 2024-04-01T15:22:05.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7fd799400640 1 -- 172.21.15.142:0/1382867905 learned_addr learned my addr 172.21.15.142:0/1382867905 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f3bb1600640 1 -- 172.21.15.142:0/1285693986 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0031770 con 0x7f3bb4146ec0 2024-04-01T15:22:05.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f3bb1600640 1 -- 172.21.15.142:0/1285693986 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba0037070 con 0x7f3bb4146ec0 2024-04-01T15:22:05.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.207+0000 7f3bb1600640 1 -- 172.21.15.142:0/1285693986 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0031b30 con 0x7f3bb4146ec0 2024-04-01T15:22:05.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f6c36000640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c38143e40 0x7f6c3813edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:22:05.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f6c37400640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c3814d600 0x7f6c381343f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c30038000 tx=0x7f6c30004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f09d2200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40c6960 0x7f09c40c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f09d2200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40c6960 0x7f09c40c3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:56830/0 (socket says 172.21.15.142:56830) 2024-04-01T15:22:05.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f09d2200640 1 -- 172.21.15.142:0/2035521734 learned_addr learned my addr 172.21.15.142:0/2035521734 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7f09d1800640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c4038880 0x7f09c40cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f260b200640 1 Processor -- start 2024-04-01T15:22:05.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.208+0000 7fd799e00640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd794147730 0x7fd794141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7fd799400640 1 -- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940ba280 msgr2=0x7fd79413e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7fd799400640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940ba280 0x7fd79413e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7fd799400640 1 -- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd794147730 msgr2=0x7fd794141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f260b200640 1 -- start start 2024-04-01T15:22:05.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f527ee00640 1 Processor -- start 2024-04-01T15:22:05.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f3bb9a00640 1 -- 172.21.15.142:0/1285693986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4146ec0 msgr2=0x7f3bb406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f3bb9a00640 1 --2- 172.21.15.142:0/1285693986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4146ec0 0x7f3bb406d8d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00097d0 tx=0x7f3ba002b810 comp rx=0 tx=0).stop 2024-04-01T15:22:05.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7fd799400640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd794147730 0x7fd794141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7fd799400640 1 -- 172.21.15.142:0/1382867905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79413e8b0 con 0x7fd7940b5940 2024-04-01T15:22:05.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7fd799e00640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd794147730 0x7fd794141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f6c2ea00640 1 -- 172.21.15.142:0/885911133 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30048070 con 0x7f6c3814d600 2024-04-01T15:22:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f6c2ea00640 1 -- 172.21.15.142:0/885911133 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c30043670 con 0x7f6c3814d600 2024-04-01T15:22:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f527ee00640 1 -- start start 2024-04-01T15:22:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f6c2ea00640 1 -- 172.21.15.142:0/885911133 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3003e040 con 0x7f6c3814d600 2024-04-01T15:22:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f24c2800640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc0a5b80 0x7f24bc16b620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24c40511b0 tx=0x7f24c4069070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f09d0e00640 1 -- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40c6960 msgr2=0x7f09c40c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.209+0000 7f09d0e00640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40c6960 0x7f09c40c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f09d0e00640 1 -- 172.21.15.142:0/2035521734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c4038880 msgr2=0x7f09c40cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7fec33200640 1 Processor -- start 2024-04-01T15:22:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f260b200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26040b7f00 0x7f2604144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f260b200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 0x7f2604142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f260b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260409c210 0x7f2604143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f260b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f260406c500 con 0x7f260409c210 2024-04-01T15:22:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f260b200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f260406c380 con 0x7f26040b7f00 2024-04-01T15:22:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f260b200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2604152290 con 0x7f2604141ea0 2024-04-01T15:22:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c38071160 con 0x7f6c3814d600 2024-04-01T15:22:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f24ba000640 1 -- 172.21.15.142:0/3075704981 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c40507a0 con 0x7f24bc0a5b80 2024-04-01T15:22:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc0a97a0 con 0x7f24bc0a5b80 2024-04-01T15:22:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f09d0e00640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c4038880 0x7f09c40cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f09d0e00640 1 -- 172.21.15.142:0/2035521734 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c400b1e0 con 0x7f09c403a3d0 2024-04-01T15:22:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f09d1800640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c4038880 0x7f09c40cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:22:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f2603400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 0x7f2604142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7fd799400640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940b5940 0x7fd79414ad20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd788036040 tx=0x7fd7880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f2603400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 0x7f2604142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50268/0 (socket says 172.21.15.142:50268) 2024-04-01T15:22:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f2603400640 1 -- 172.21.15.142:0/1925795274 learned_addr learned my addr 172.21.15.142:0/1925795274 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f2603e00640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26040b7f00 0x7f2604144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7fd791600640 1 -- 172.21.15.142:0/1382867905 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788042070 con 0x7fd7940b5940 2024-04-01T15:22:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f527ee00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f527806d8d0 0x7f52780aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f527ee00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780af030 0x7f52780b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f527ee00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52780b3cd0 0x7f52780b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f527ee00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f52780ae660 con 0x7f527806d8d0 2024-04-01T15:22:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f527ee00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f52780af490 con 0x7f52780b3cd0 2024-04-01T15:22:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f527ee00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f52780b03c0 con 0x7f52780af030 2024-04-01T15:22:05.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc0adaa0 con 0x7f24bc0a5b80 2024-04-01T15:22:05.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f24ba000640 1 -- 172.21.15.142:0/3075704981 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c404fe20 con 0x7f24bc0a5b80 2024-04-01T15:22:05.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f24ba000640 1 -- 172.21.15.142:0/3075704981 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c406cdf0 con 0x7f24bc0a5b80 2024-04-01T15:22:05.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3813a2c0 con 0x7f6c3814d600 2024-04-01T15:22:05.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7f09d0e00640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c403a3d0 0x7f09c40c3130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f09c000e930 tx=0x7f09c000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7fd791600640 1 -- 172.21.15.142:0/1382867905 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78803d870 con 0x7fd7940b5940 2024-04-01T15:22:05.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7fd791600640 1 -- 172.21.15.142:0/1382867905 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788038040 con 0x7fd7940b5940 2024-04-01T15:22:05.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f3bb9a00640 1 -- 172.21.15.142:0/1285693986 shutdown_connections 2024-04-01T15:22:05.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f3bb9a00640 1 --2- 172.21.15.142:0/1285693986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4146ec0 0x7f3bb406d8d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7f3bb9a00640 1 -- 172.21.15.142:0/1285693986 >> 172.21.15.142:0/1285693986 conn(0x7f3bb40b5890 msgr2=0x7f3bb40b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.210+0000 7fec33200640 1 -- start start 2024-04-01T15:22:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7fec33200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c00c530 0x7fec2c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7fec33200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec2c01e9e0 0x7fec2c03aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7fec33200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2c03bba0 con 0x7fec2c0214e0 2024-04-01T15:22:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7fec33200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fec2c01dd60 con 0x7fec2c01e9e0 2024-04-01T15:22:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7fec33200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fec2c00c910 con 0x7fec2c00c530 2024-04-01T15:22:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7f527ce00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52780b3cd0 0x7f52780b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7f527ce00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52780b3cd0 0x7f52780b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:56846/0 (socket says 172.21.15.142:56846) 2024-04-01T15:22:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7f527ce00640 1 -- 172.21.15.142:0/2908325723 learned_addr learned my addr 172.21.15.142:0/2908325723 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7f3bb9a00640 1 -- 172.21.15.142:0/1285693986 shutdown_connections 2024-04-01T15:22:05.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7fec31e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c00c530 0x7fec2c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7fec31e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c00c530 0x7fec2c03a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50280/0 (socket says 172.21.15.142:50280) 2024-04-01T15:22:05.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7fec31e00640 1 -- 172.21.15.142:0/2294954165 learned_addr learned my addr 172.21.15.142:0/2294954165 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7f5277400640 1 --2- 172.21.15.142:0/2908325723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780af030 0x7f52780b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79413db10 con 0x7fd7940b5940 2024-04-01T15:22:05.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79413d830 con 0x7fd7940b5940 2024-04-01T15:22:05.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.211+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f249c001030 con 0x7f24bc0a5b80 2024-04-01T15:22:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7f2609200640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260409c210 0x7f2604143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f2603400640 1 -- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26040b7f00 msgr2=0x7f2604144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f2603400640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26040b7f00 0x7f2604144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f2603400640 1 -- 172.21.15.142:0/1925795274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260409c210 msgr2=0x7f2604143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f2603400640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260409c210 0x7f2604143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f2603400640 1 -- 172.21.15.142:0/1925795274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260413e480 con 0x7f2604141ea0 2024-04-01T15:22:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7fec30a00640 1 -- 172.21.15.142:0/2294954165 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897000065 0 0) 0x7fec2c03bba0 con 0x7fec2c0214e0 2024-04-01T15:22:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7fec30a00640 1 -- 172.21.15.142:0/2294954165 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec18003520 con 0x7fec2c0214e0 2024-04-01T15:22:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f5277400640 1 -- 172.21.15.142:0/2908325723 >> v2:172.21.15.179:3300/0 conn(0x7f52780b3cd0 msgr2=0x7f52780b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f5277400640 1 --2- 172.21.15.142:0/2908325723 >> v2:172.21.15.179:3300/0 conn(0x7f52780b3cd0 0x7f52780b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f5277400640 1 -- 172.21.15.142:0/2908325723 >> v2:172.21.15.142:3300/0 conn(0x7f527806d8d0 msgr2=0x7f52780aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f5277400640 1 --2- 172.21.15.142:0/2908325723 >> v2:172.21.15.142:3300/0 conn(0x7f527806d8d0 0x7f52780aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f5277400640 1 -- 172.21.15.142:0/2908325723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52780b56b0 con 0x7f52780af030 2024-04-01T15:22:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7fec31e00640 1 -- 172.21.15.142:0/2294954165 >> v2:172.21.15.179:3300/0 conn(0x7fec2c01e9e0 msgr2=0x7fec2c03aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7f2609200640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260409c210 0x7f2604143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:05.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.214+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd794068590 con 0x7fd7940b5940 2024-04-01T15:22:05.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7fec31e00640 1 --2- 172.21.15.142:0/2294954165 >> v2:172.21.15.179:3300/0 conn(0x7fec2c01e9e0 0x7fec2c03aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.212+0000 7f3bb9a00640 1 -- 172.21.15.142:0/1285693986 wait complete. 2024-04-01T15:22:05.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7fec31e00640 1 -- 172.21.15.142:0/2294954165 >> v1:172.21.15.179:6789/0 conn(0x7fec2c0214e0 legacy=0x7fec2c021950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.213+0000 7fec31e00640 1 -- 172.21.15.142:0/2294954165 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c01d430 con 0x7fec2c00c530 2024-04-01T15:22:05.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.214+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c38135490 con 0x7f6c3814d600 2024-04-01T15:22:05.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.214+0000 7f09c9600640 1 -- 172.21.15.142:0/2035521734 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0017070 con 0x7f09c403a3d0 2024-04-01T15:22:05.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.214+0000 7f2603400640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 0x7f2604142360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c4d0 tx=0x7f25f000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.214+0000 7f24ba000640 1 -- 172.21.15.142:0/3075704981 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24c4093030 con 0x7f24bc0a5b80 2024-04-01T15:22:05.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.214+0000 7f09c9600640 1 -- 172.21.15.142:0/2035521734 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c000ca00 con 0x7f09c403a3d0 2024-04-01T15:22:05.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.214+0000 7f09c9600640 1 -- 172.21.15.142:0/2035521734 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c000cdd0 con 0x7f09c403a3d0 2024-04-01T15:22:05.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.215+0000 7f09d2c00640 1 -- 172.21.15.142:0/2035521734 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c4009ed0 con 0x7f09c403a3d0 2024-04-01T15:22:05.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.215+0000 7f3bb9a00640 1 Processor -- start 2024-04-01T15:22:05.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.215+0000 7fec31e00640 1 --2- 172.21.15.142:0/2294954165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c00c530 0x7fec2c03a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fec24009870 tx=0x7fec2402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dda1c579d8e4e3f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.215+0000 7f3bb9a00640 1 -- start start 2024-04-01T15:22:05.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.215+0000 7f5277400640 1 --2- 172.21.15.142:0/2908325723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780af030 0x7f52780b3790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f52780b9df0 tx=0x7f526402b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbdf44ed8ed349a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.215+0000 7fec30a00640 1 -- 172.21.15.142:0/2294954165 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24035020 con 0x7fec2c00c530 2024-04-01T15:22:05.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.215+0000 7f24ba000640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f24a406c8f0 0x7f24a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.215+0000 7f24ba000640 1 -- 172.21.15.142:0/3075704981 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f24c41064c0 con 0x7f24bc0a5b80 2024-04-01T15:22:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7fec30a00640 1 -- 172.21.15.142:0/2294954165 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec24031640 con 0x7fec2c00c530 2024-04-01T15:22:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f24ba000640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f24a4074a90 0x7f24a4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f24ba000640 1 -- 172.21.15.142:0/3075704981 --> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24c409ae70 con 0x7f24a4074a90 2024-04-01T15:22:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f24ba000640 1 -- 172.21.15.142:0/3075704981 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f24c4106950 con 0x7f24bc0a5b80 2024-04-01T15:22:05.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f25fbe00640 1 -- 172.21.15.142:0/1925795274 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0017070 con 0x7f2604141ea0 2024-04-01T15:22:05.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f5276a00640 1 -- 172.21.15.142:0/2908325723 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264038070 con 0x7f52780af030 2024-04-01T15:22:05.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f5276a00640 1 -- 172.21.15.142:0/2908325723 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5264033640 con 0x7f52780af030 2024-04-01T15:22:05.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f5276a00640 1 -- 172.21.15.142:0/2908325723 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264033a10 con 0x7f52780af030 2024-04-01T15:22:05.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.215+0000 7f09d2c00640 1 -- 172.21.15.142:0/2035521734 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c40c8d50 con 0x7f09c403a3d0 2024-04-01T15:22:05.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f24c1e00640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f24a406c8f0 0x7f24a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f24c1400640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f24a4074a90 0x7f24a4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f25fbe00640 1 -- 172.21.15.142:0/1925795274 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f0005ce0 con 0x7f2604141ea0 2024-04-01T15:22:05.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f25fbe00640 1 -- 172.21.15.142:0/1925795274 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0007270 con 0x7f2604141ea0 2024-04-01T15:22:05.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260409c760 con 0x7f2604141ea0 2024-04-01T15:22:05.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.217+0000 7f24c1400640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f24a4074a90 0x7f24a4076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.217+0000 7f6c2ea00640 1 -- 172.21.15.142:0/885911133 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c3004b070 con 0x7f6c3814d600 2024-04-01T15:22:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26041457b0 con 0x7f2604141ea0 2024-04-01T15:22:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.217+0000 7f3bb9a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb406df60 0x7f3bb406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.217+0000 7f3bb9a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb4146ec0 0x7f3bb4070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.217+0000 7f3bb9a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb414c1e0 0x7f3bb40b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.216+0000 7fec30a00640 1 -- 172.21.15.142:0/2294954165 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2402d040 con 0x7fec2c00c530 2024-04-01T15:22:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f3bb9a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb40ae950 con 0x7f3bb4146ec0 2024-04-01T15:22:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f3bb9a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb40afe80 con 0x7f3bb406df60 2024-04-01T15:22:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f3bb9a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb4143f60 con 0x7f3bb414c1e0 2024-04-01T15:22:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.217+0000 7f527ee00640 1 -- 172.21.15.142:0/2908325723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780af030 msgr2=0x7f52780b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.217+0000 7f527ee00640 1 --2- 172.21.15.142:0/2908325723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780af030 0x7f52780b3790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f52780b9df0 tx=0x7f526402b720 comp rx=0 tx=0).stop 2024-04-01T15:22:05.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.217+0000 7f09bea00640 1 -- 172.21.15.142:0/2035521734 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09a0001030 con 0x7f09c403a3d0 2024-04-01T15:22:05.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25dc001030 con 0x7f2604141ea0 2024-04-01T15:22:05.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7fec33200640 1 -- 172.21.15.142:0/2294954165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c00c530 msgr2=0x7fec2c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7fec33200640 1 --2- 172.21.15.142:0/2294954165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c00c530 0x7fec2c03a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fec24009870 tx=0x7fec2402b8f0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f527ee00640 1 -- 172.21.15.142:0/2908325723 shutdown_connections 2024-04-01T15:22:05.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f3bb2a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb406df60 0x7f3bb406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f527ee00640 1 --2- 172.21.15.142:0/2908325723 >> v2:172.21.15.179:3300/0 conn(0x7f52780b3cd0 0x7f52780b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f527ee00640 1 --2- 172.21.15.142:0/2908325723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780af030 0x7f52780b3790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f527ee00640 1 --2- 172.21.15.142:0/2908325723 >> v2:172.21.15.142:3300/0 conn(0x7f527806d8d0 0x7f52780aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f527ee00640 1 -- 172.21.15.142:0/2908325723 >> 172.21.15.142:0/2908325723 conn(0x7f52780b5890 msgr2=0x7f52780b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7fec33200640 1 -- 172.21.15.142:0/2294954165 shutdown_connections 2024-04-01T15:22:05.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f527ee00640 1 -- 172.21.15.142:0/2908325723 shutdown_connections 2024-04-01T15:22:05.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.219+0000 7f527ee00640 1 -- 172.21.15.142:0/2908325723 wait complete. 2024-04-01T15:22:05.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.219+0000 7fec33200640 1 --2- 172.21.15.142:0/2294954165 >> v2:172.21.15.179:3300/0 conn(0x7fec2c01e9e0 0x7fec2c03aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.219+0000 7fec33200640 1 --2- 172.21.15.142:0/2294954165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c00c530 0x7fec2c03a760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f6c2ea00640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6c1806c8f0 0x7f6c1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f6c2ea00640 1 -- 172.21.15.142:0/885911133 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c300b2880 con 0x7f6c3814d600 2024-04-01T15:22:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f6c2ea00640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7f6c18074a90 0x7f6c18076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f6c2ea00640 1 -- 172.21.15.142:0/885911133 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c3004be50 con 0x7f6c18074a90 2024-04-01T15:22:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f6c2ea00640 1 -- 172.21.15.142:0/885911133 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6c300b2d10 con 0x7f6c3814d600 2024-04-01T15:22:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.219+0000 7f6c36000640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7f6c18074a90 0x7f6c18076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.219+0000 7f6c36a00640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6c1806c8f0 0x7f6c1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f24ba000640 1 -- 172.21.15.142:0/3075704981 <== osd.1 v2:172.21.15.142:6821/2553070769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24c409ae70 con 0x7f24a4074a90 2024-04-01T15:22:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.219+0000 7fd791600640 1 -- 172.21.15.142:0/1382867905 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd788045070 con 0x7fd7940b5940 2024-04-01T15:22:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.219+0000 7fec33200640 1 -- 172.21.15.142:0/2294954165 >> 172.21.15.142:0/2294954165 conn(0x7fec2c00b7a0 msgr2=0x7fec2c00bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.220+0000 7f6c36000640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7f6c18074a90 0x7f6c18076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.220+0000 7fd791600640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd77406c940 0x7fd77406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.220+0000 7f6c36a00640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6c1806c8f0 0x7f6c1806edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c24007fd0 tx=0x7f6c24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.220+0000 7f24c1e00640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f24a406c8f0 0x7f24a406edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24b4034000 tx=0x7f24b4009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.220+0000 7fd791600640 1 -- 172.21.15.142:0/1382867905 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd7880ad880 con 0x7fd7940b5940 2024-04-01T15:22:05.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7fd791600640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fd774074bc0 0x7fd774076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f3bb2a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb406df60 0x7f3bb406fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:56874/0 (socket says 172.21.15.142:56874) 2024-04-01T15:22:05.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.218+0000 7f3bb2a00640 1 -- 172.21.15.142:0/577524013 learned_addr learned my addr 172.21.15.142:0/577524013 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.219+0000 7f3bb3400640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb414c1e0 0x7f3bb40b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.220+0000 7f3bb2a00640 1 -- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb414c1e0 msgr2=0x7f3bb40b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.220+0000 7f3bb2a00640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb414c1e0 0x7f3bb40b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.220+0000 7f3bb2a00640 1 -- 172.21.15.142:0/577524013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb4146ec0 msgr2=0x7f3bb4070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7fd791600640 1 -- 172.21.15.142:0/1382867905 --> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd774077690 con 0x7fd774074bc0 2024-04-01T15:22:05.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7fd791600640 1 -- 172.21.15.142:0/1382867905 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd7880add60 con 0x7fd7940b5940 2024-04-01T15:22:05.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7fec33200640 1 -- 172.21.15.142:0/2294954165 shutdown_connections 2024-04-01T15:22:05.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7f3bb2000640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb4146ec0 0x7f3bb4070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7f3bb2a00640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb4146ec0 0x7f3bb4070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7f3bb2a00640 1 -- 172.21.15.142:0/577524013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb4070cc0 con 0x7f3bb406df60 2024-04-01T15:22:05.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7f3bb2000640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb4146ec0 0x7f3bb4070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:05.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7fd799e00640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fd774074bc0 0x7fd774076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.222+0000 7fd798a00640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd77406c940 0x7fd77406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7f25fbe00640 1 -- 172.21.15.142:0/1925795274 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25f001a070 con 0x7f2604141ea0 2024-04-01T15:22:05.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.222+0000 7f3bb2a00640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb406df60 0x7f3bb406fa00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c430 tx=0x7f3ba400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.221+0000 7fec33200640 1 -- 172.21.15.142:0/2294954165 wait complete. 2024-04-01T15:22:05.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.222+0000 7f527ee00640 1 Processor -- start 2024-04-01T15:22:05.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.222+0000 7f6c2ea00640 1 -- 172.21.15.142:0/885911133 <== osd.0 v2:172.21.15.142:6808/3934118532 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c3004be50 con 0x7f6c18074a90 2024-04-01T15:22:05.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.222+0000 7f527ee00640 1 -- start start 2024-04-01T15:22:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.222+0000 7f3baaa00640 1 -- 172.21.15.142:0/577524013 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4017070 con 0x7f3bb406df60 2024-04-01T15:22:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.222+0000 7fd799e00640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fd774074bc0 0x7fd774076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.223+0000 7f3baaa00640 1 -- 172.21.15.142:0/577524013 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba4005ce0 con 0x7f3bb406df60 2024-04-01T15:22:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.223+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb4072570 con 0x7f3bb406df60 2024-04-01T15:22:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.223+0000 7fd798a00640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd77406c940 0x7fd77406ee00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd794145450 tx=0x7fd780001d70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.223+0000 7f3baaa00640 1 -- 172.21.15.142:0/577524013 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40072f0 con 0x7f3bb406df60 2024-04-01T15:22:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb40b8af0 con 0x7f3bb406df60 2024-04-01T15:22:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.222+0000 7f09c9600640 1 -- 172.21.15.142:0/2035521734 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09c001a070 con 0x7f09c403a3d0 2024-04-01T15:22:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f09c9600640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f09ac06c9c0 0x7f09ac06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f09c9600640 1 -- 172.21.15.142:0/2035521734 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f09c008be60 con 0x7f09c403a3d0 2024-04-01T15:22:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f09c9600640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f09ac074c40 0x7f09ac077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f09c9600640 1 -- 172.21.15.142:0/2035521734 --> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09c001ee50 con 0x7f09ac074c40 2024-04-01T15:22:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f09c9600640 1 -- 172.21.15.142:0/2035521734 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f09c008c250 con 0x7f09c403a3d0 2024-04-01T15:22:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7fec33200640 1 Processor -- start 2024-04-01T15:22:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f25fbe00640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f25e406c9c0 0x7f25e406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f25fbe00640 1 -- 172.21.15.142:0/1925795274 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f25f008b490 con 0x7f2604141ea0 2024-04-01T15:22:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f09d1800640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f09ac06c9c0 0x7f09ac06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.224+0000 7f25fbe00640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7f25e4074c40 0x7f25e4077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f25fbe00640 1 -- 172.21.15.142:0/1925795274 --> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25f000ee50 con 0x7f25e4074c40 2024-04-01T15:22:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f25fbe00640 1 -- 172.21.15.142:0/1925795274 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f25f008b880 con 0x7f2604141ea0 2024-04-01T15:22:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7fec33200640 1 -- start start 2024-04-01T15:22:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f527ee00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f527806d8d0 0x7f52780b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f09d2200640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f09ac074c40 0x7f09ac077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f527ee00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52780af030 0x7f52781419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f527ee00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780b3cd0 0x7f52781e1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f527ee00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f52780b53d0 con 0x7f52780af030 2024-04-01T15:22:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f527ee00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f52780ae050 con 0x7f527806d8d0 2024-04-01T15:22:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f527ee00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f52780afd70 con 0x7f52780b3cd0 2024-04-01T15:22:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f2609200640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7f25e4074c40 0x7f25e4077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bb4068710 con 0x7f3bb406df60 2024-04-01T15:22:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.225+0000 7f2603e00640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f25e406c9c0 0x7f25e406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.226+0000 7f5277400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52780af030 0x7f52781419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.226+0000 7fd791600640 1 -- 172.21.15.142:0/1382867905 <== osd.4 v2:172.21.15.179:6816/934337813 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd774077690 con 0x7fd774074bc0 2024-04-01T15:22:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.226+0000 7f5277400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52780af030 0x7f52781419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51116/0 (socket says 172.21.15.142:51116) 2024-04-01T15:22:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.226+0000 7f5277400640 1 -- 172.21.15.142:0/1473776591 learned_addr learned my addr 172.21.15.142:0/1473776591 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.226+0000 7f5277e00640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f527806d8d0 0x7f52780b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7f527ce00640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780b3cd0 0x7f52781e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7f5277400640 1 -- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780b3cd0 msgr2=0x7f52781e1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7fec33200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2c00c530 0x7fec2c038ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7f5277400640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52780b3cd0 0x7f52781e1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7f5277400640 1 -- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f527806d8d0 msgr2=0x7f52780b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7f5277400640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f527806d8d0 0x7f52780b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7f5277400640 1 -- 172.21.15.142:0/1473776591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527814b330 con 0x7f52780af030 2024-04-01T15:22:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7fec33200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c01e9e0 0x7fec2c033910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7fec33200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec2c0214e0 0x7fec2c0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7f5277400640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52780af030 0x7f52781419f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5264009890 tx=0x7f52640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7f2603e00640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f25e406c9c0 0x7f25e406ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25f4036000 tx=0x7f25f4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7fec33200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c01e220 con 0x7fec2c00c530 2024-04-01T15:22:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.228+0000 7fec33200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c01d9f0 con 0x7fec2c0214e0 2024-04-01T15:22:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.228+0000 7fec33200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fec2c03c5c0 con 0x7fec2c01e9e0 2024-04-01T15:22:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.228+0000 7fec31e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2c00c530 0x7fec2c038ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.228+0000 7fec31e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2c00c530 0x7fec2c038ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51128/0 (socket says 172.21.15.142:51128) 2024-04-01T15:22:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.228+0000 7fec31e00640 1 -- 172.21.15.142:0/3771942949 learned_addr learned my addr 172.21.15.142:0/3771942949 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.228+0000 7fec31400640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c01e9e0 0x7fec2c033910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.228+0000 7fec38a00640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec2c0214e0 0x7fec2c0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.227+0000 7f09d2200640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f09ac074c40 0x7f09ac077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7fec31400640 1 -- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec2c0214e0 msgr2=0x7fec2c0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7fec31400640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec2c0214e0 0x7fec2c0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7fec31400640 1 -- 172.21.15.142:0/3771942949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2c00c530 msgr2=0x7fec2c038ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7fec31400640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2c00c530 0x7fec2c038ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7fec31400640 1 -- 172.21.15.142:0/3771942949 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c161a90 con 0x7fec2c01e9e0 2024-04-01T15:22:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7fec31e00640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2c00c530 0x7fec2c038ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:05.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7f526fe00640 1 -- 172.21.15.142:0/1473776591 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264042020 con 0x7f52780af030 2024-04-01T15:22:05.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7f526fe00640 1 -- 172.21.15.142:0/1473776591 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52640308c0 con 0x7f52780af030 2024-04-01T15:22:05.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7f526fe00640 1 -- 172.21.15.142:0/1473776591 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264038040 con 0x7f52780af030 2024-04-01T15:22:05.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.229+0000 7f527ee00640 1 -- 172.21.15.142:0/1473776591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52781d6cd0 con 0x7f52780af030 2024-04-01T15:22:05.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.230+0000 7f09c9600640 1 -- 172.21.15.142:0/2035521734 <== osd.2 v2:172.21.15.142:6816/894905692 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09c001ee50 con 0x7f09ac074c40 2024-04-01T15:22:05.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.230+0000 7fec31400640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c01e9e0 0x7fec2c033910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec2000b3c0 tx=0x7fec2000b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.230+0000 7f527ee00640 1 -- 172.21.15.142:0/1473776591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f527814a000 con 0x7f52780af030 2024-04-01T15:22:05.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.230+0000 7f09d1800640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f09ac06c9c0 0x7f09ac06ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09cc065040 tx=0x7f09cc08bf90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.230+0000 7f2609200640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7f25e4074c40 0x7f25e4077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.231+0000 7fec2a000640 1 -- 172.21.15.142:0/3771942949 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20011830 con 0x7fec2c01e9e0 2024-04-01T15:22:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.231+0000 7fec2a000640 1 -- 172.21.15.142:0/3771942949 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec20016070 con 0x7fec2c01e9e0 2024-04-01T15:22:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.231+0000 7fec2a000640 1 -- 172.21.15.142:0/3771942949 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20011c10 con 0x7fec2c01e9e0 2024-04-01T15:22:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.232+0000 7f25fbe00640 1 -- 172.21.15.142:0/1925795274 <== osd.3 v2:172.21.15.142:6800/208376799 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25f000ee50 con 0x7f25e4074c40 2024-04-01T15:22:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.232+0000 7fec33200640 1 -- 172.21.15.142:0/3771942949 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2c161d70 con 0x7fec2c01e9e0 2024-04-01T15:22:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.232+0000 7fec33200640 1 -- 172.21.15.142:0/3771942949 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2c0399b0 con 0x7fec2c01e9e0 2024-04-01T15:22:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.231+0000 7f526d600640 1 -- 172.21.15.142:0/1473776591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f524c001030 con 0x7f52780af030 2024-04-01T15:22:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.231+0000 7f3baaa00640 1 -- 172.21.15.142:0/577524013 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ba401a070 con 0x7f3bb406df60 2024-04-01T15:22:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.233+0000 7f3baaa00640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3b9406c8f0 0x7f3b9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.233+0000 7f3baaa00640 1 -- 172.21.15.142:0/577524013 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ba40943a0 con 0x7f3bb406df60 2024-04-01T15:22:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.233+0000 7fec1f400640 1 -- 172.21.15.142:0/3771942949 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec08001030 con 0x7fec2c01e9e0 2024-04-01T15:22:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.233+0000 7f3baaa00640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3b94074b70 0x7f3b94076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.233+0000 7f3baaa00640 1 -- 172.21.15.142:0/577524013 --> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b94077640 con 0x7f3b94074b70 2024-04-01T15:22:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.233+0000 7f3baaa00640 1 -- 172.21.15.142:0/577524013 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3ba4090060 con 0x7f3bb406df60 2024-04-01T15:22:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.236+0000 7f3bb2000640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3b9406c8f0 0x7f3b9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.236+0000 7f526fe00640 1 -- 172.21.15.142:0/1473776591 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5264045020 con 0x7f52780af030 2024-04-01T15:22:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.236+0000 7f3bb3400640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3b94074b70 0x7f3b94076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.236+0000 7fec2a000640 1 -- 172.21.15.142:0/3771942949 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec2001b460 con 0x7fec2c01e9e0 2024-04-01T15:22:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.237+0000 7f526fe00640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f525806c9c0 0x7f525806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.237+0000 7f526fe00640 1 -- 172.21.15.142:0/1473776591 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f52640ad7d0 con 0x7f52780af030 2024-04-01T15:22:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.237+0000 7fec2a000640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fec1406c9c0 0x7fec1406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.238+0000 7fec2a000640 1 -- 172.21.15.142:0/3771942949 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fec2008b6e0 con 0x7fec2c01e9e0 2024-04-01T15:22:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.238+0000 7f526fe00640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7f5258074c40 0x7f5258077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.238+0000 7f526fe00640 1 -- 172.21.15.142:0/1473776591 --> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5264033640 con 0x7f5258074c40 2024-04-01T15:22:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.238+0000 7f526fe00640 1 -- 172.21.15.142:0/1473776591 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f52640adbc0 con 0x7f52780af030 2024-04-01T15:22:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.238+0000 7fec2a000640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7fec14074c40 0x7fec14077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.238+0000 7fec2a000640 1 -- 172.21.15.142:0/3771942949 --> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec14077710 con 0x7fec14074c40 2024-04-01T15:22:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.238+0000 7fec2a000640 1 -- 172.21.15.142:0/3771942949 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fec20092050 con 0x7fec2c01e9e0 2024-04-01T15:22:05.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.238+0000 7f5277e00640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f525806c9c0 0x7f525806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.238+0000 7f3bb2000640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3b9406c8f0 0x7f3b9406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0036000 tx=0x7f3ba0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.239+0000 7f3bb3400640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3b94074b70 0x7f3b94076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.239+0000 7fec31e00640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fec1406c9c0 0x7fec1406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.239+0000 7fec38a00640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7fec14074c40 0x7fec14077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.239+0000 7f527ce00640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7f5258074c40 0x7f5258077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.240+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 --> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f249c002dd0 con 0x7f24a4074a90 2024-04-01T15:22:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.240+0000 7f5277e00640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f525806c9c0 0x7f525806ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5268009990 tx=0x7f5268009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.240+0000 7f527ce00640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7f5258074c40 0x7f5258077060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.240+0000 7fec31e00640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fec1406c9c0 0x7fec1406ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec24009870 tx=0x7fec2403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.240+0000 7f24ba000640 1 -- 172.21.15.142:0/3075704981 <== osd.1 v2:172.21.15.142:6821/2553070769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f249c002dd0 con 0x7f24a4074a90 2024-04-01T15:22:05.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7fec38a00640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7fec14074c40 0x7fec14077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f24a4074a90 msgr2=0x7f24a4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7f24c3200640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f24a4074a90 0x7f24a4076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f24a406c8f0 msgr2=0x7f24a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7f24c3200640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f24a406c8f0 0x7f24a406edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24b4034000 tx=0x7f24b4009030 comp rx=0 tx=0).stop 2024-04-01T15:22:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc0a5b80 msgr2=0x7f24bc16b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7f24c3200640 1 --2- 172.21.15.142:0/3075704981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc0a5b80 0x7f24bc16b620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24c40511b0 tx=0x7f24c4069070 comp rx=0 tx=0).stop 2024-04-01T15:22:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7f24c2800640 1 -- 172.21.15.142:0/3075704981 reap_dead start 2024-04-01T15:22:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 shutdown_connections 2024-04-01T15:22:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.241+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 >> 172.21.15.142:0/3075704981 conn(0x7f24bc03abf0 msgr2=0x7f24bc0d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.242+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 shutdown_connections 2024-04-01T15:22:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.242+0000 7f24c3200640 1 -- 172.21.15.142:0/3075704981 wait complete. 2024-04-01T15:22:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.242+0000 7f526fe00640 1 -- 172.21.15.142:0/1473776591 <== osd.7 v2:172.21.15.179:6806/3234577124 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5264033640 con 0x7f5258074c40 2024-04-01T15:22:05.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.243+0000 7f3baaa00640 1 -- 172.21.15.142:0/577524013 <== osd.5 v2:172.21.15.179:6817/1223314628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b94077640 con 0x7f3b94074b70 2024-04-01T15:22:05.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.246+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c38068710 con 0x7f6c18074a90 2024-04-01T15:22:05.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.246+0000 7fec2a000640 1 -- 172.21.15.142:0/3771942949 <== osd.6 v2:172.21.15.179:6800/1199445012 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec14077710 con 0x7fec14074c40 2024-04-01T15:22:05.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.249+0000 7f6c2ea00640 1 -- 172.21.15.142:0/885911133 <== osd.0 v2:172.21.15.142:6808/3934118532 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6c38068710 con 0x7f6c18074a90 2024-04-01T15:22:05.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.250+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7f6c18074a90 msgr2=0x7f6c18076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.250+0000 7f6c3d800640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7f6c18074a90 0x7f6c18076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.251+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6c1806c8f0 msgr2=0x7f6c1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.251+0000 7f6c3d800640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6c1806c8f0 0x7f6c1806edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c24007fd0 tx=0x7f6c24009040 comp rx=0 tx=0).stop 2024-04-01T15:22:05.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.251+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c3814d600 msgr2=0x7f6c381343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.251+0000 7f6c3d800640 1 --2- 172.21.15.142:0/885911133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c3814d600 0x7f6c381343f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c30038000 tx=0x7f6c30004a40 comp rx=0 tx=0).stop 2024-04-01T15:22:05.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.251+0000 7f6c37400640 1 -- 172.21.15.142:0/885911133 reap_dead start 2024-04-01T15:22:05.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.252+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 shutdown_connections 2024-04-01T15:22:05.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.252+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 >> 172.21.15.142:0/885911133 conn(0x7f6c3809b300 msgr2=0x7f6c380b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.252+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 shutdown_connections 2024-04-01T15:22:05.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.252+0000 7f6c3d800640 1 -- 172.21.15.142:0/885911133 wait complete. 2024-04-01T15:22:05.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.261+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 --> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd7940bb0c0 con 0x7fd774074bc0 2024-04-01T15:22:05.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.262+0000 7fd791600640 1 -- 172.21.15.142:0/1382867905 <== osd.4 v2:172.21.15.179:6816/934337813 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd7940bb0c0 con 0x7fd774074bc0 2024-04-01T15:22:05.295 INFO:teuthology.orchestra.run.smithi142.stdout:55834574856 2024-04-01T15:22:05.295 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.262+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fd774074bc0 msgr2=0x7fd774076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.262+0000 7fd79a800640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fd774074bc0 0x7fd774076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.263+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd77406c940 msgr2=0x7fd77406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.263+0000 7fd79a800640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd77406c940 0x7fd77406ee00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd794145450 tx=0x7fd780001d70 comp rx=0 tx=0).stop 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.263+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940b5940 msgr2=0x7fd79414ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.263+0000 7fd79a800640 1 --2- 172.21.15.142:0/1382867905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7940b5940 0x7fd79414ad20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd788036040 tx=0x7fd7880046c0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.263+0000 7fd799e00640 1 -- 172.21.15.142:0/1382867905 reap_dead start 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.263+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 shutdown_connections 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.263+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 >> 172.21.15.142:0/1382867905 conn(0x7fd7940bd4b0 msgr2=0x7fd794147ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.263+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 shutdown_connections 2024-04-01T15:22:05.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.263+0000 7fd79a800640 1 -- 172.21.15.142:0/1382867905 wait complete. 2024-04-01T15:22:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.264+0000 7f09bea00640 1 -- 172.21.15.142:0/2035521734 --> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09a0002dd0 con 0x7f09ac074c40 2024-04-01T15:22:05.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.265+0000 7f09c9600640 1 -- 172.21.15.142:0/2035521734 <== osd.2 v2:172.21.15.142:6816/894905692 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f09a0002dd0 con 0x7f09ac074c40 2024-04-01T15:22:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.266+0000 7f09bea00640 1 -- 172.21.15.142:0/2035521734 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f09ac074c40 msgr2=0x7f09ac077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.266+0000 7f09bea00640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f09ac074c40 0x7f09ac077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.266+0000 7f09bea00640 1 -- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f09ac06c9c0 msgr2=0x7f09ac06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.266+0000 7f09bea00640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f09ac06c9c0 0x7f09ac06ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09cc065040 tx=0x7f09cc08bf90 comp rx=0 tx=0).stop 2024-04-01T15:22:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.266+0000 7f09bea00640 1 -- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c403a3d0 msgr2=0x7f09c40c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.266+0000 7f09bea00640 1 --2- 172.21.15.142:0/2035521734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c403a3d0 0x7f09c40c3130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f09c000e930 tx=0x7f09c000edf0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.267+0000 7f09d2200640 1 -- 172.21.15.142:0/2035521734 reap_dead start 2024-04-01T15:22:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.267+0000 7f09bea00640 1 -- 172.21.15.142:0/2035521734 shutdown_connections 2024-04-01T15:22:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.267+0000 7f09bea00640 1 -- 172.21.15.142:0/2035521734 >> 172.21.15.142:0/2035521734 conn(0x7f09c403ea70 msgr2=0x7f09c403e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.267+0000 7f09bea00640 1 -- 172.21.15.142:0/2035521734 shutdown_connections 2024-04-01T15:22:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.267+0000 7f09bea00640 1 -- 172.21.15.142:0/2035521734 wait complete. 2024-04-01T15:22:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.268+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 --> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25dc002dd0 con 0x7f25e4074c40 2024-04-01T15:22:05.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.269+0000 7f25fbe00640 1 -- 172.21.15.142:0/1925795274 <== osd.3 v2:172.21.15.142:6800/208376799 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f25dc002dd0 con 0x7f25e4074c40 2024-04-01T15:22:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.269+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7f25e4074c40 msgr2=0x7f25e4077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.269+0000 7f260b200640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7f25e4074c40 0x7f25e4077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.272+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f25e406c9c0 msgr2=0x7f25e406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.272+0000 7f260b200640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f25e406c9c0 0x7f25e406ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25f4036000 tx=0x7f25f4008030 comp rx=0 tx=0).stop 2024-04-01T15:22:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.272+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 msgr2=0x7f2604142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.272+0000 7f260b200640 1 --2- 172.21.15.142:0/1925795274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2604141ea0 0x7f2604142360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c4d0 tx=0x7f25f000c990 comp rx=0 tx=0).stop 2024-04-01T15:22:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.272+0000 7f2609200640 1 -- 172.21.15.142:0/1925795274 reap_dead start 2024-04-01T15:22:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.272+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 shutdown_connections 2024-04-01T15:22:05.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.272+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 >> 172.21.15.142:0/1925795274 conn(0x7f26040b9b40 msgr2=0x7f26040b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.272+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 --> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3bb4146020 con 0x7f3b94074b70 2024-04-01T15:22:05.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.273+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 shutdown_connections 2024-04-01T15:22:05.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.273+0000 7f260b200640 1 -- 172.21.15.142:0/1925795274 wait complete. 2024-04-01T15:22:05.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.273+0000 7f3baaa00640 1 -- 172.21.15.142:0/577524013 <== osd.5 v2:172.21.15.179:6817/1223314628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3bb4146020 con 0x7f3b94074b70 2024-04-01T15:22:05.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.274+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3b94074b70 msgr2=0x7f3b94076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.274+0000 7f526d600640 1 -- 172.21.15.142:0/1473776591 --> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f524c002dd0 con 0x7f5258074c40 2024-04-01T15:22:05.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.274+0000 7f3bb9a00640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3b94074b70 0x7f3b94076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.274+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3b9406c8f0 msgr2=0x7f3b9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.274+0000 7f3bb9a00640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f3b9406c8f0 0x7f3b9406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0036000 tx=0x7f3ba0008030 comp rx=0 tx=0).stop 2024-04-01T15:22:05.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.275+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb406df60 msgr2=0x7f3bb406fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.275+0000 7f3bb9a00640 1 --2- 172.21.15.142:0/577524013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb406df60 0x7f3bb406fa00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c430 tx=0x7f3ba400c8f0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.275+0000 7f3bb3400640 1 -- 172.21.15.142:0/577524013 reap_dead start 2024-04-01T15:22:05.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.275+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 shutdown_connections 2024-04-01T15:22:05.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.275+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 >> 172.21.15.142:0/577524013 conn(0x7f3bb40b5890 msgr2=0x7f3bb4146540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.275+0000 7fec1f400640 1 -- 172.21.15.142:0/3771942949 --> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec08002dd0 con 0x7fec14074c40 2024-04-01T15:22:05.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.275+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 shutdown_connections 2024-04-01T15:22:05.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.275+0000 7f3bb9a00640 1 -- 172.21.15.142:0/577524013 wait complete. 2024-04-01T15:22:05.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.276+0000 7f526fe00640 1 -- 172.21.15.142:0/1473776591 <== osd.7 v2:172.21.15.179:6806/3234577124 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f524c002dd0 con 0x7f5258074c40 2024-04-01T15:22:05.305 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-04-01T15:22:05.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.276+0000 7fec2a000640 1 -- 172.21.15.142:0/3771942949 <== osd.6 v2:172.21.15.179:6800/1199445012 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fec08002dd0 con 0x7fec14074c40 2024-04-01T15:22:05.306 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-01T15:22:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.276+0000 7f526d600640 1 -- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7f5258074c40 msgr2=0x7f5258077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.276+0000 7f526d600640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7f5258074c40 0x7f5258077060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7f526d600640 1 -- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f525806c9c0 msgr2=0x7f525806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7f526d600640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f525806c9c0 0x7f525806ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5268009990 tx=0x7f5268009110 comp rx=0 tx=0).stop 2024-04-01T15:22:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7fec1f400640 1 -- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7fec14074c40 msgr2=0x7fec14077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7fec1f400640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7fec14074c40 0x7fec14077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7f526d600640 1 -- 172.21.15.142:0/1473776591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52780af030 msgr2=0x7f52781419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7f526d600640 1 --2- 172.21.15.142:0/1473776591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52780af030 0x7f52781419f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5264009890 tx=0x7f52640046c0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7f527ce00640 1 -- 172.21.15.142:0/1473776591 reap_dead start 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7fec1f400640 1 -- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fec1406c9c0 msgr2=0x7fec1406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7fec1f400640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fec1406c9c0 0x7fec1406ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec24009870 tx=0x7fec2403c040 comp rx=0 tx=0).stop 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7fec1f400640 1 -- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c01e9e0 msgr2=0x7fec2c033910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7fec1f400640 1 --2- 172.21.15.142:0/3771942949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec2c01e9e0 0x7fec2c033910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec2000b3c0 tx=0x7fec2000b880 comp rx=0 tx=0).stop 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7fec38a00640 1 -- 172.21.15.142:0/3771942949 reap_dead start 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7fec1f400640 1 -- 172.21.15.142:0/3771942949 shutdown_connections 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7fec1f400640 1 -- 172.21.15.142:0/3771942949 >> 172.21.15.142:0/3771942949 conn(0x7fec2c00b7a0 msgr2=0x7fec2c03dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7f526d600640 1 -- 172.21.15.142:0/1473776591 shutdown_connections 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.277+0000 7f526d600640 1 -- 172.21.15.142:0/1473776591 >> 172.21.15.142:0/1473776591 conn(0x7f52780b5890 msgr2=0x7f527814d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.278+0000 7fec1f400640 1 -- 172.21.15.142:0/3771942949 shutdown_connections 2024-04-01T15:22:05.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.278+0000 7f526d600640 1 -- 172.21.15.142:0/1473776591 shutdown_connections 2024-04-01T15:22:05.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.278+0000 7f526d600640 1 -- 172.21.15.142:0/1473776591 wait complete. 2024-04-01T15:22:05.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.278+0000 7fec1f400640 1 -- 172.21.15.142:0/3771942949 wait complete. 2024-04-01T15:22:05.311 INFO:teuthology.orchestra.run.smithi142.stdout:55834574856 2024-04-01T15:22:05.311 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-01T15:22:05.312 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2024-04-01T15:22:05.312 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-01T15:22:05.313 INFO:teuthology.orchestra.run.smithi142.stdout:55834574855 2024-04-01T15:22:05.313 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-01T15:22:05.314 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2024-04-01T15:22:05.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-01T15:22:05.315 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2024-04-01T15:22:05.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-01T15:22:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2024-04-01T15:22:05.316 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-01T15:22:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.629+0000 7fe552200640 1 Processor -- start 2024-04-01T15:22:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.630+0000 7fe552200640 1 -- start start 2024-04-01T15:22:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.631+0000 7fe552200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c148c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.631+0000 7fe552200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe54c0b4750 0x7fe54c14f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.632+0000 7fe54b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.632+0000 7fe54aa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe54c0b4750 0x7fe54c14f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.633+0000 7fe54aa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe54c0b4750 0x7fe54c14f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51142/0 (socket says 172.21.15.142:51142) 2024-04-01T15:22:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.633+0000 7fe54b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50328/0 (socket says 172.21.15.142:50328) 2024-04-01T15:22:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.633+0000 7fe54be00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe54c149170 0x7fe54c0b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44282/0 (socket says 172.21.15.142:44282) 2024-04-01T15:22:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.634+0000 7fe552200640 1 -- 172.21.15.142:0/2566369244 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe54c06dba0 con 0x7fe54c149170 2024-04-01T15:22:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.634+0000 7fe552200640 1 -- 172.21.15.142:0/2566369244 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe54c0afa60 con 0x7fe54c0b4750 2024-04-01T15:22:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.634+0000 7fe552200640 1 -- 172.21.15.142:0/2566369244 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe54c0ae720 con 0x7fe54c06d7c0 2024-04-01T15:22:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.633+0000 7fe54aa00640 1 -- 172.21.15.142:0/2566369244 learned_addr learned my addr 172.21.15.142:0/2566369244 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.635+0000 7fe54aa00640 1 -- 172.21.15.142:0/2566369244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 msgr2=0x7fe54c148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.635+0000 7fe54a000640 1 -- 172.21.15.142:0/2566369244 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487688199 0 0) 0x7fe54c06dba0 con 0x7fe54c149170 2024-04-01T15:22:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.635+0000 7fe54aa00640 1 --2- 172.21.15.142:0/2566369244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.635+0000 7fe54aa00640 1 -- 172.21.15.142:0/2566369244 >> v1:172.21.15.142:6789/0 conn(0x7fe54c149170 legacy=0x7fe54c0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.635+0000 7fe54aa00640 1 -- 172.21.15.142:0/2566369244 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c0aea00 con 0x7fe54c0b4750 2024-04-01T15:22:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.636+0000 7fe54b400640 1 --2- 172.21.15.142:0/2566369244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:22:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.637+0000 7fe54aa00640 1 --2- 172.21.15.142:0/2566369244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 0x7fe54c14f320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe544009e50 tx=0x7fe54402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9b0d9128c6e1b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.637+0000 7fe54a000640 1 -- 172.21.15.142:0/2566369244 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54402cb00 con 0x7fe54c0b4750 2024-04-01T15:22:05.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.637+0000 7fe54a000640 1 -- 172.21.15.142:0/2566369244 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54402cca0 con 0x7fe54c0b4750 2024-04-01T15:22:05.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.637+0000 7fe54a000640 1 -- 172.21.15.142:0/2566369244 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544034610 con 0x7fe54c0b4750 2024-04-01T15:22:05.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.641+0000 7fe552200640 1 -- 172.21.15.142:0/2566369244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 msgr2=0x7fe54c14f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.641+0000 7fe552200640 1 --2- 172.21.15.142:0/2566369244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 0x7fe54c14f320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe544009e50 tx=0x7fe54402bf60 comp rx=0 tx=0).stop 2024-04-01T15:22:05.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.642+0000 7fe552200640 1 -- 172.21.15.142:0/2566369244 shutdown_connections 2024-04-01T15:22:05.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.642+0000 7fe552200640 1 --2- 172.21.15.142:0/2566369244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 0x7fe54c14f320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.642+0000 7fe552200640 1 --2- 172.21.15.142:0/2566369244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.642+0000 7fe552200640 1 -- 172.21.15.142:0/2566369244 >> 172.21.15.142:0/2566369244 conn(0x7fe54c0b5790 msgr2=0x7fe54c0b5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.642+0000 7fe552200640 1 -- 172.21.15.142:0/2566369244 shutdown_connections 2024-04-01T15:22:05.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.643+0000 7fe552200640 1 -- 172.21.15.142:0/2566369244 wait complete. 2024-04-01T15:22:05.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.645+0000 7fe552200640 1 Processor -- start 2024-04-01T15:22:05.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.645+0000 7fe552200640 1 -- start start 2024-04-01T15:22:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.646+0000 7fe552200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.646+0000 7fe552200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 0x7fe54c1e4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.646+0000 7fe552200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe54c149170 0x7fe54c1e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.646+0000 7fe552200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0ae330 con 0x7fe54c0b4750 2024-04-01T15:22:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.646+0000 7fe552200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0aece0 con 0x7fe54c149170 2024-04-01T15:22:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.646+0000 7fe552200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe54c0ae4b0 con 0x7fe54c06d7c0 2024-04-01T15:22:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.647+0000 7fe54aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 0x7fe54c1e4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.647+0000 7fe54aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 0x7fe54c1e4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51150/0 (socket says 172.21.15.142:51150) 2024-04-01T15:22:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.647+0000 7fe54aa00640 1 -- 172.21.15.142:0/2040994047 learned_addr learned my addr 172.21.15.142:0/2040994047 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.647+0000 7fe54b400640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.647+0000 7fe54be00640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe54c149170 0x7fe54c1e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.648+0000 7fe54aa00640 1 -- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 msgr2=0x7fe54c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.648+0000 7fe54aa00640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c0b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.648+0000 7fe54aa00640 1 -- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe54c149170 msgr2=0x7fe54c1e52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.648+0000 7fe54aa00640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe54c149170 0x7fe54c1e52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.648+0000 7fe54aa00640 1 -- 172.21.15.142:0/2040994047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c06f9d0 con 0x7fe54c0b4750 2024-04-01T15:22:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.649+0000 7fb899e00640 1 Processor -- start 2024-04-01T15:22:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.649+0000 7fe54aa00640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 0x7fe54c1e4d70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe544000f80 tx=0x7fe544004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.649+0000 7fb899e00640 1 -- start start 2024-04-01T15:22:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.650+0000 7f4786400640 1 Processor -- start 2024-04-01T15:22:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.650+0000 7fe543400640 1 -- 172.21.15.142:0/2040994047 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544043020 con 0x7fe54c0b4750 2024-04-01T15:22:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.650+0000 7fe543400640 1 -- 172.21.15.142:0/2040994047 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54402ce50 con 0x7fe54c0b4750 2024-04-01T15:22:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.650+0000 7fe543400640 1 -- 172.21.15.142:0/2040994047 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544009510 con 0x7fe54c0b4750 2024-04-01T15:22:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.650+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c070de0 con 0x7fe54c0b4750 2024-04-01T15:22:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.650+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c1249d0 con 0x7fe54c0b4750 2024-04-01T15:22:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.650+0000 7f117a400640 1 Processor -- start 2024-04-01T15:22:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.650+0000 7f117a400640 1 -- start start 2024-04-01T15:22:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.651+0000 7fb899e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8941411e0 0x7fb894141630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.651+0000 7fb899e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8940b5720 con 0x7fb8940b60a0 2024-04-01T15:22:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.651+0000 7fb899e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb894147850 con 0x7fb8940b5cc0 2024-04-01T15:22:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.650+0000 7f4786400640 1 -- start start 2024-04-01T15:22:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.651+0000 7fb899e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb894148760 con 0x7fb8941411e0 2024-04-01T15:22:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.652+0000 7fb892000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb8940b60a0 0x7fb894148050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44292/0 (socket says 172.21.15.142:44292) 2024-04-01T15:22:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.652+0000 7fb892000640 1 -- 172.21.15.142:0/1883439992 learned_addr learned my addr 172.21.15.142:0/1883439992 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.652+0000 7f4786400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47800b5fd0 0x7f478014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.652+0000 7f117a400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11740aed40 0x7f11741480c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.652+0000 7f117a400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11740b1d70 0x7f11741522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.652+0000 7f117a400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11740b8a20 con 0x7f1174148600 2024-04-01T15:22:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.652+0000 7f117a400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f11740af120 con 0x7f11740b1d70 2024-04-01T15:22:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.652+0000 7f117a400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f11740b0430 con 0x7f11740aed40 2024-04-01T15:22:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f4786400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f478014b610 0x7f4780152180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.652+0000 7fb893400640 1 --2- 172.21.15.142:0/1883439992 >> v2:172.21.15.142:3300/0 conn(0x7fb8941411e0 0x7fb894141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f4786400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47800bde40 con 0x7f47800bda60 2024-04-01T15:22:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f4786400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f47800b5120 con 0x7f47800b5fd0 2024-04-01T15:22:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f6ba5600640 1 Processor -- start 2024-04-01T15:22:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe54c068590 con 0x7fe54c0b4750 2024-04-01T15:22:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f1173e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11740b1d70 0x7f11741522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f1172a00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1174148600 0x7f11740b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44306/0 (socket says 172.21.15.142:44306) 2024-04-01T15:22:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f1172a00640 1 -- 172.21.15.142:0/1858057612 learned_addr learned my addr 172.21.15.142:0/1858057612 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f4786400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f47800b53e0 con 0x7f478014b610 2024-04-01T15:22:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f477ea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47800b5fd0 0x7f478014b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194527943 0 0) 0x7fb8940b5720 con 0x7fb8940b60a0 2024-04-01T15:22:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb878003520 con 0x7fb8940b60a0 2024-04-01T15:22:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7f6ba5600640 1 -- start start 2024-04-01T15:22:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.653+0000 7f477ea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47800b5fd0 0x7f478014b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51160/0 (socket says 172.21.15.142:51160) 2024-04-01T15:22:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7f477ea00640 1 -- 172.21.15.142:0/3665388505 learned_addr learned my addr 172.21.15.142:0/3665388505 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7f477f400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f47800bda60 0x7f4780141670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44298/0 (socket says 172.21.15.142:44298) 2024-04-01T15:22:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7f477fe00640 1 --2- 172.21.15.142:0/3665388505 >> v2:172.21.15.179:3300/0 conn(0x7f478014b610 0x7f4780152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231818183 0 0) 0x7fb894147850 con 0x7fb8940b5cc0 2024-04-01T15:22:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8940b5720 con 0x7fb8940b5cc0 2024-04-01T15:22:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1378244707 0 0) 0x7fb8940b5720 con 0x7fb8940b5cc0 2024-04-01T15:22:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 >> v2:172.21.15.142:3300/0 conn(0x7fb8941411e0 msgr2=0x7fb894141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7f477ea00640 1 -- 172.21.15.142:0/3665388505 >> v2:172.21.15.179:3300/0 conn(0x7f478014b610 msgr2=0x7f4780152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7f477ea00640 1 --2- 172.21.15.142:0/3665388505 >> v2:172.21.15.179:3300/0 conn(0x7f478014b610 0x7f4780152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7f477ea00640 1 -- 172.21.15.142:0/3665388505 >> v1:172.21.15.142:6789/0 conn(0x7f47800bda60 legacy=0x7f4780141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7f477ea00640 1 -- 172.21.15.142:0/3665388505 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47800b56c0 con 0x7f47800b5fd0 2024-04-01T15:22:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7f1173e00640 1 -- 172.21.15.142:0/1858057612 >> v2:172.21.15.179:3300/0 conn(0x7f11740aed40 msgr2=0x7f11741480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7f1173e00640 1 --2- 172.21.15.142:0/1858057612 >> v2:172.21.15.179:3300/0 conn(0x7f11740aed40 0x7f11741480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7f1173e00640 1 -- 172.21.15.142:0/1858057612 >> v1:172.21.15.142:6789/0 conn(0x7f1174148600 legacy=0x7f11740b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.654+0000 7f1173e00640 1 -- 172.21.15.142:0/1858057612 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11740ae680 con 0x7f11740b1d70 2024-04-01T15:22:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7fb891600640 1 --2- 172.21.15.142:0/1883439992 >> v2:172.21.15.142:3300/0 conn(0x7fb8941411e0 0x7fb894141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 >> v1:172.21.15.142:6789/0 conn(0x7fb8940b60a0 legacy=0x7fb894148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb894147b30 con 0x7fb8940b5cc0 2024-04-01T15:22:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7f82c7800640 1 Processor -- start 2024-04-01T15:22:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7f1173e00640 1 --2- 172.21.15.142:0/1858057612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11740b1d70 0x7f11741522c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f117409f0e0 tx=0x7f116c02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2dc03d449a6e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.655+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7fb880001670 con 0x7fb8940b5cc0 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 >> v1:172.21.15.179:6789/0 conn(0x7fb8940b5cc0 legacy=0x7fb8940b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7fb891600640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb878004bf0 0x7fb878004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7fb891600640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb878003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7fb891600640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8780041b0 0x7fb87800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb894148760 con 0x7fb878004bf0 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb878014950 con 0x7fb8780041b0 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb878014b50 con 0x7fb8780037a0 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7f6ba5600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ba014b420 0x7f6ba0152e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7f6ba5600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba00bdbd0 con 0x7f6ba00bd7f0 2024-04-01T15:22:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7f6ba5600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba00b57b0 con 0x7f6ba0141970 2024-04-01T15:22:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7f6ba5600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6ba00b5a90 con 0x7f6ba014b420 2024-04-01T15:22:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7fe543400640 1 -- 172.21.15.142:0/2040994047 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe544046020 con 0x7fe54c0b4750 2024-04-01T15:22:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7f82c7800640 1 -- start start 2024-04-01T15:22:05.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7f6b9fe00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6ba00bd7f0 0x7f6ba0141260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44308/0 (socket says 172.21.15.142:44308) 2024-04-01T15:22:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7f6b9fe00640 1 -- 172.21.15.142:0/2965419116 learned_addr learned my addr 172.21.15.142:0/2965419116 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7f6b9f400640 1 --1- 172.21.15.142:0/2965419116 >> v1:172.21.15.179:6789/0 conn(0x7f6ba0141970 0x7f6ba014ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.142:34378/0 (socket says 172.21.15.142:34378) 2024-04-01T15:22:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7fe543400640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe52c06c940 0x7fe52c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7fe543400640 1 -- 172.21.15.142:0/2040994047 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe5440adf30 con 0x7fe54c0b4750 2024-04-01T15:22:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7f82c7800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c00b5f00 0x7f82c0141630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7f82c7800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f82c0147ce0 0x7f82c0148130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 135732854 0 0) 0x7f6ba00b57b0 con 0x7f6ba0141970 2024-04-01T15:22:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b84003520 con 0x7f6ba0141970 2024-04-01T15:22:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7f82c7800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c00b62e0 con 0x7f82c0141b70 2024-04-01T15:22:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7f82c7800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f82c00b4bf0 con 0x7f82c0147ce0 2024-04-01T15:22:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7f82c7800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f82c00b45a0 con 0x7f82c00b5f00 2024-04-01T15:22:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1037865384 0 0) 0x7f6b84003520 con 0x7f6ba0141970 2024-04-01T15:22:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 >> v2:172.21.15.142:3300/0 conn(0x7f6ba014b420 msgr2=0x7f6ba0152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 --2- 172.21.15.142:0/2965419116 >> v2:172.21.15.142:3300/0 conn(0x7f6ba014b420 0x7f6ba0152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 >> v1:172.21.15.142:6789/0 conn(0x7f6ba00bd7f0 legacy=0x7f6ba0141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba00b5d70 con 0x7f6ba0141970 2024-04-01T15:22:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f6b8c0015a0 con 0x7f6ba0141970 2024-04-01T15:22:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 >> v1:172.21.15.179:6789/0 conn(0x7f6ba0141970 legacy=0x7f6ba014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b84003a00 0x7f6b84003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b84004800 0x7f6b84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b840053c0 0x7f6b8400ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba00b5a90 con 0x7f6b840053c0 2024-04-01T15:22:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8400c2e0 con 0x7f6b84004800 2024-04-01T15:22:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8400c4e0 con 0x7f6b84003a00 2024-04-01T15:22:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7fe54b400640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe52c06c940 0x7fe52c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.656+0000 7fb892000640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb878003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7fb893400640 1 --2- 172.21.15.142:0/1883439992 >> v2:172.21.15.142:3300/0 conn(0x7fb8941411e0 0x7fb894141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:05.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7fb893400640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8780041b0 0x7fb87800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7fb892000640 1 -- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8780041b0 msgr2=0x7fb87800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7fb892000640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8780041b0 0x7fb87800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7fb892000640 1 -- 172.21.15.142:0/1883439992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb878004bf0 msgr2=0x7fb878004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7fb892000640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb878004bf0 0x7fb878004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7fb892000640 1 -- 172.21.15.142:0/1883439992 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8940b5720 con 0x7fb8780037a0 2024-04-01T15:22:05.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.658+0000 7fb893400640 1 -- 172.21.15.142:0/1883439992 reap_dead start 2024-04-01T15:22:05.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.659+0000 7f82c4e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c00b5f00 0x7f82c0141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.659+0000 7f82c4e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c00b5f00 0x7f82c0141630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50352/0 (socket says 172.21.15.142:50352) 2024-04-01T15:22:05.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.659+0000 7f82c4e00640 1 -- 172.21.15.142:0/330972530 learned_addr learned my addr 172.21.15.142:0/330972530 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.659+0000 7f6b9f400640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b84004800 0x7f6b84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.657+0000 7f477fe00640 1 --2- 172.21.15.142:0/3665388505 >> v2:172.21.15.179:3300/0 conn(0x7f478014b610 0x7f4780152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:05.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.659+0000 7f6b9fe00640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b84003a00 0x7f6b84003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.659+0000 7f6ba4c00640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b840053c0 0x7f6b8400ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.659+0000 7ff96d400640 1 Processor -- start 2024-04-01T15:22:05.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.659+0000 7f82c5800640 1 --2- 172.21.15.142:0/330972530 >> v2:172.21.15.142:3300/0 conn(0x7f82c0147ce0 0x7f82c0148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f82c4e00640 1 -- 172.21.15.142:0/330972530 >> v2:172.21.15.142:3300/0 conn(0x7f82c0147ce0 msgr2=0x7f82c0148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7fb892000640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb878003c20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb8840019c0 tx=0x7fb878005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=444def97a02314f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f82c4e00640 1 --2- 172.21.15.142:0/330972530 >> v2:172.21.15.142:3300/0 conn(0x7f82c0147ce0 0x7f82c0148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f82c4e00640 1 -- 172.21.15.142:0/330972530 >> v1:172.21.15.179:6789/0 conn(0x7f82c0141b70 legacy=0x7f82c00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f82c4e00640 1 -- 172.21.15.142:0/330972530 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c00b4880 con 0x7f82c00b5f00 2024-04-01T15:22:05.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f6ba4c00640 1 -- 172.21.15.142:0/2965419116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b84003a00 msgr2=0x7f6b84003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f6ba4c00640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b84003a00 0x7f6b84003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f6ba4c00640 1 -- 172.21.15.142:0/2965419116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b84004800 msgr2=0x7f6b84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f6ba4c00640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b84004800 0x7f6b84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f6ba4c00640 1 -- 172.21.15.142:0/2965419116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba00b5d70 con 0x7f6b840053c0 2024-04-01T15:22:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7fe54b400640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe52c06c940 0x7fe52c06ee00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe54c144600 tx=0x7fe53c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f6b9f400640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b84004800 0x7f6b84004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7f477ea00640 1 --2- 172.21.15.142:0/3665388505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800b5fd0 0x7f478014b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47800b5990 tx=0x7f477802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbf5c33a580ba34 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7ff96d400640 1 -- start start 2024-04-01T15:22:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884037070 con 0x7fb8780037a0 2024-04-01T15:22:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb884004aa0 con 0x7fb8780037a0 2024-04-01T15:22:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.660+0000 7fb891600640 1 -- 172.21.15.142:0/1883439992 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884001610 con 0x7fb8780037a0 2024-04-01T15:22:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.661+0000 7f6ba4c00640 1 -- 172.21.15.142:0/2965419116 reap_dead start 2024-04-01T15:22:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.661+0000 7ff96d400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff96806d8d0 0x7ff9680aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.661+0000 7f6ba4c00640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b840053c0 0x7f6b8400ba00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009e40 tx=0x7f6b84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7433db59a03df3cf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.661+0000 7ff96d400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9680b3ea0 0x7ff968156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.661+0000 7ff96d400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9680b56b0 con 0x7ff9680af030 2024-04-01T15:22:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.661+0000 7fb899e00640 1 -- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 msgr2=0x7fb878003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.661+0000 7fb899e00640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb878003c20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb8840019c0 tx=0x7fb878005830 comp rx=0 tx=0).stop 2024-04-01T15:22:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7fb899e00640 1 -- 172.21.15.142:0/1883439992 shutdown_connections 2024-04-01T15:22:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7fb899e00640 1 --2- 172.21.15.142:0/1883439992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb878003c20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7fb899e00640 1 -- 172.21.15.142:0/1883439992 >> 172.21.15.142:0/1883439992 conn(0x7fb8940b9b50 msgr2=0x7fb8940b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.661+0000 7ff966800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff96806d8d0 0x7ff9680aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7ff96d400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff9680ae660 con 0x7ff96806d8d0 2024-04-01T15:22:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7ff966800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff96806d8d0 0x7ff9680aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:56948/0 (socket says 172.21.15.142:56948) 2024-04-01T15:22:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7ff96d400640 1 -- 172.21.15.142:0/914646875 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff9680af490 con 0x7ff9680b3ea0 2024-04-01T15:22:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7ff966800640 1 -- 172.21.15.142:0/914646875 learned_addr learned my addr 172.21.15.142:0/914646875 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7ff967200640 1 --2- 172.21.15.142:0/914646875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9680b3ea0 0x7ff968156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7f82c4e00640 1 --2- 172.21.15.142:0/330972530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c00b5f00 0x7f82c0141630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009e50 tx=0x7f82b802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3381dde05814bc87 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7fb899e00640 1 -- 172.21.15.142:0/1883439992 shutdown_connections 2024-04-01T15:22:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7fb899e00640 1 -- 172.21.15.142:0/1883439992 wait complete. 2024-04-01T15:22:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7f82bf400640 1 -- 172.21.15.142:0/330972530 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b802ca80 con 0x7f82c00b5f00 2024-04-01T15:22:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7f82bf400640 1 -- 172.21.15.142:0/330972530 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b802cc20 con 0x7f82c00b5f00 2024-04-01T15:22:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7f82bf400640 1 -- 172.21.15.142:0/330972530 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b80343f0 con 0x7f82c00b5f00 2024-04-01T15:22:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7ff966800640 1 -- 172.21.15.142:0/914646875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9680b3ea0 msgr2=0x7ff968156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7ff966800640 1 --2- 172.21.15.142:0/914646875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9680b3ea0 0x7ff968156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7ff966800640 1 -- 172.21.15.142:0/914646875 >> v1:172.21.15.142:6789/0 conn(0x7ff9680af030 legacy=0x7ff9680b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.662+0000 7ff966800640 1 -- 172.21.15.142:0/914646875 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96806dcb0 con 0x7ff96806d8d0 2024-04-01T15:22:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.663+0000 7f82c7800640 1 -- 172.21.15.142:0/330972530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c00b5f00 msgr2=0x7f82c0141630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.663+0000 7f82c7800640 1 --2- 172.21.15.142:0/330972530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c00b5f00 0x7f82c0141630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009e50 tx=0x7f82b802bee0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.663+0000 7fb899e00640 1 Processor -- start 2024-04-01T15:22:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.663+0000 7f82c7800640 1 -- 172.21.15.142:0/330972530 shutdown_connections 2024-04-01T15:22:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.663+0000 7f82c7800640 1 --2- 172.21.15.142:0/330972530 >> v2:172.21.15.142:3300/0 conn(0x7f82c0147ce0 0x7f82c0148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.663+0000 7f82c7800640 1 --2- 172.21.15.142:0/330972530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c00b5f00 0x7f82c0141630 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.663+0000 7f82c7800640 1 -- 172.21.15.142:0/330972530 >> 172.21.15.142:0/330972530 conn(0x7f82c00bd100 msgr2=0x7f82c00bd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.663+0000 7fa2bc600640 1 Processor -- start 2024-04-01T15:22:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7f82c7800640 1 -- 172.21.15.142:0/330972530 shutdown_connections 2024-04-01T15:22:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7fb899e00640 1 -- start start 2024-04-01T15:22:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7f82c7800640 1 -- 172.21.15.142:0/330972530 wait complete. 2024-04-01T15:22:05.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7fa2bc600640 1 -- start start 2024-04-01T15:22:05.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7ff966800640 1 --2- 172.21.15.142:0/914646875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff96806d8d0 0x7ff9680aeaf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff950009870 tx=0x7ff95002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f54ae7a9bc36c2e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7fb899e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb8940aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7ff965400640 1 -- 172.21.15.142:0/914646875 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9500317c0 con 0x7ff96806d8d0 2024-04-01T15:22:05.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7fb899e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb894072530 0x7fb8940a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7ff965400640 1 -- 172.21.15.142:0/914646875 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff950037070 con 0x7ff96806d8d0 2024-04-01T15:22:05.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7ff965400640 1 -- 172.21.15.142:0/914646875 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff950031b80 con 0x7ff96806d8d0 2024-04-01T15:22:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7fb899e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8941dc050 0x7fb8941dc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7fb899e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb894148050 con 0x7fb894072530 2024-04-01T15:22:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7fb899e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb8940b7a50 con 0x7fb8941dc050 2024-04-01T15:22:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.664+0000 7fb899e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb8941481d0 con 0x7fb8780037a0 2024-04-01T15:22:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.665+0000 7fb892a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb8940aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.665+0000 7fb892000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb894072530 0x7fb8940a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.665+0000 7fb892a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb8940aa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50366/0 (socket says 172.21.15.142:50366) 2024-04-01T15:22:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.665+0000 7fb892a00640 1 -- 172.21.15.142:0/3127893418 learned_addr learned my addr 172.21.15.142:0/3127893418 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.665+0000 7ff96d400640 1 -- 172.21.15.142:0/914646875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff96806d8d0 msgr2=0x7ff9680aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.665+0000 7ff96d400640 1 --2- 172.21.15.142:0/914646875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff96806d8d0 0x7ff9680aeaf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff950009870 tx=0x7ff95002b860 comp rx=0 tx=0).stop 2024-04-01T15:22:05.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.665+0000 7fb893400640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8941dc050 0x7fb8941dc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.665+0000 7fa2bc600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b406b790 0x7fa2b40b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.665+0000 7fa2bc600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2b414f400 0x7fa2b4072c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7f82c7800640 1 Processor -- start 2024-04-01T15:22:05.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fa2bc600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b40b6710 con 0x7fa2b40731a0 2024-04-01T15:22:05.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fa2bc600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa2b40b0b60 con 0x7fa2b414f400 2024-04-01T15:22:05.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fa2bc600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b40b56a0 con 0x7fa2b406b790 2024-04-01T15:22:05.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fe543400640 1 -- 172.21.15.142:0/2040994047 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe54404d030 con 0x7fe54c0b4750 2024-04-01T15:22:05.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7f82c7800640 1 -- start start 2024-04-01T15:22:05.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7f1172000640 1 -- 172.21.15.142:0/1858057612 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c039070 con 0x7f11740b1d70 2024-04-01T15:22:05.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7f1172000640 1 -- 172.21.15.142:0/1858057612 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f116c02cb50 con 0x7f11740b1d70 2024-04-01T15:22:05.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7f1172000640 1 -- 172.21.15.142:0/1858057612 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c034440 con 0x7f11740b1d70 2024-04-01T15:22:05.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c007ba0 con 0x7f6b840053c0 2024-04-01T15:22:05.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b98006e50 con 0x7f6b840053c0 2024-04-01T15:22:05.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fa2b9200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2b414f400 0x7fa2b4072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7f6b9ea00640 1 -- 172.21.15.142:0/2965419116 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98009a10 con 0x7f6b840053c0 2024-04-01T15:22:05.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fa2b9200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2b414f400 0x7fa2b4072c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51230/0 (socket says 172.21.15.142:51230) 2024-04-01T15:22:05.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fa2b9200640 1 -- 172.21.15.142:0/2845675525 learned_addr learned my addr 172.21.15.142:0/2845675525 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fb892a00640 1 -- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8941dc050 msgr2=0x7fb8941dc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fb892a00640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8941dc050 0x7fb8941dc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fb892a00640 1 -- 172.21.15.142:0/3127893418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb894072530 msgr2=0x7fb8940a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fb892a00640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb894072530 0x7fb8940a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7fa2b9200640 1 -- 172.21.15.142:0/2845675525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b406b790 msgr2=0x7fa2b40b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7fb892a00640 1 -- 172.21.15.142:0/3127893418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8940a9a60 con 0x7fb8780037a0 2024-04-01T15:22:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7fa2b9c00640 1 --2- 172.21.15.142:0/2845675525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b406b790 0x7fa2b40b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7fa2b9200640 1 --2- 172.21.15.142:0/2845675525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b406b790 0x7fa2b40b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7fa2b9200640 1 -- 172.21.15.142:0/2845675525 >> v1:172.21.15.179:6789/0 conn(0x7fa2b40731a0 legacy=0x7fa2b406da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7fa2b9200640 1 -- 172.21.15.142:0/2845675525 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b40b0d90 con 0x7fa2b414f400 2024-04-01T15:22:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.666+0000 7f477e000640 1 -- 172.21.15.142:0/3665388505 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477802ca80 con 0x7f47800b5fd0 2024-04-01T15:22:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f477e000640 1 -- 172.21.15.142:0/3665388505 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477802cc20 con 0x7f47800b5fd0 2024-04-01T15:22:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f477e000640 1 -- 172.21.15.142:0/3665388505 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47780343f0 con 0x7f47800b5fd0 2024-04-01T15:22:05.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7fa2b9c00640 1 --2- 172.21.15.142:0/2845675525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b406b790 0x7fa2b40b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:05.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f117a400640 1 -- 172.21.15.142:0/1858057612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11740b1d70 msgr2=0x7f11741522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f117a400640 1 --2- 172.21.15.142:0/1858057612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11740b1d70 0x7f11741522c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f117409f0e0 tx=0x7f116c02bda0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f82c7800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82c00b5f00 0x7f82c014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f82c7800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c0141b70 0x7f82c01444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f117a400640 1 -- 172.21.15.142:0/1858057612 shutdown_connections 2024-04-01T15:22:05.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f117a400640 1 --2- 172.21.15.142:0/1858057612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11740b1d70 0x7f11741522c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7ff96d400640 1 -- 172.21.15.142:0/914646875 shutdown_connections 2024-04-01T15:22:05.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7ff96d400640 1 --2- 172.21.15.142:0/914646875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9680b3ea0 0x7ff968156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7ff96d400640 1 --2- 172.21.15.142:0/914646875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff96806d8d0 0x7ff9680aeaf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7ff96d400640 1 -- 172.21.15.142:0/914646875 >> 172.21.15.142:0/914646875 conn(0x7ff9680b5890 msgr2=0x7ff9680b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f117a400640 1 --2- 172.21.15.142:0/1858057612 >> v2:172.21.15.179:3300/0 conn(0x7f11740aed40 0x7f11741480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f117a400640 1 -- 172.21.15.142:0/1858057612 >> 172.21.15.142:0/1858057612 conn(0x7f11740b6c90 msgr2=0x7f11740b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f117a400640 1 -- 172.21.15.142:0/1858057612 shutdown_connections 2024-04-01T15:22:05.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7fb892a00640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb8940aa9f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb88000c730 tx=0x7fb88000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f6ba5600640 1 -- 172.21.15.142:0/2965419116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b840053c0 msgr2=0x7f6b8400ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7fb88b400640 1 -- 172.21.15.142:0/3127893418 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880017070 con 0x7fb8780037a0 2024-04-01T15:22:05.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7fb88b400640 1 -- 172.21.15.142:0/3127893418 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb880005290 con 0x7fb8780037a0 2024-04-01T15:22:05.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7fb88b400640 1 -- 172.21.15.142:0/3127893418 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88000a880 con 0x7fb8780037a0 2024-04-01T15:22:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f6ba5600640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b840053c0 0x7f6b8400ba00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009e40 tx=0x7f6b84005830 comp rx=0 tx=0).stop 2024-04-01T15:22:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f4786400640 1 -- 172.21.15.142:0/3665388505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800b5fd0 msgr2=0x7f478014b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f4786400640 1 --2- 172.21.15.142:0/3665388505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800b5fd0 0x7f478014b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47800b5990 tx=0x7f477802bee0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f4786400640 1 -- 172.21.15.142:0/3665388505 shutdown_connections 2024-04-01T15:22:05.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f6ba5600640 1 -- 172.21.15.142:0/2965419116 shutdown_connections 2024-04-01T15:22:05.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f6ba5600640 1 --2- 172.21.15.142:0/2965419116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b840053c0 0x7f6b8400ba00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f6ba5600640 1 -- 172.21.15.142:0/2965419116 >> 172.21.15.142:0/2965419116 conn(0x7f6ba0074ae0 msgr2=0x7f6ba00bce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f4786400640 1 --2- 172.21.15.142:0/3665388505 >> v2:172.21.15.179:3300/0 conn(0x7f478014b610 0x7f4780152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f4786400640 1 --2- 172.21.15.142:0/3665388505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800b5fd0 0x7f478014b0d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f4786400640 1 -- 172.21.15.142:0/3665388505 >> 172.21.15.142:0/3665388505 conn(0x7f47800734b0 msgr2=0x7f47800bd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f117a400640 1 -- 172.21.15.142:0/1858057612 wait complete. 2024-04-01T15:22:05.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f6ba5600640 1 -- 172.21.15.142:0/2965419116 shutdown_connections 2024-04-01T15:22:05.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f6ba5600640 1 -- 172.21.15.142:0/2965419116 wait complete. 2024-04-01T15:22:05.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7ff96d400640 1 -- 172.21.15.142:0/914646875 shutdown_connections 2024-04-01T15:22:05.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8940ab1b0 con 0x7fb8780037a0 2024-04-01T15:22:05.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.669+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8940ab770 con 0x7fb8780037a0 2024-04-01T15:22:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.669+0000 7fa2b9200640 1 --2- 172.21.15.142:0/2845675525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b414f400 0x7fa2b4072c60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009870 tx=0x7fa2a002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60eda0539de9e07 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f82c7800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c0147ce0 0x7f82c01e55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.669+0000 7fa2b3e00640 1 -- 172.21.15.142:0/2845675525 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0035020 con 0x7fa2b414f400 2024-04-01T15:22:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f82c7800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00b5910 con 0x7f82c00b5f00 2024-04-01T15:22:05.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f82c7800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00b5790 con 0x7f82c0141b70 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.667+0000 7f82c7800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f82c0152130 con 0x7f82c0147ce0 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f82bfe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c0141b70 0x7f82c01444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f82bfe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c0141b70 0x7f82c01444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:56968/0 (socket says 172.21.15.142:56968) 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f82bfe00640 1 -- 172.21.15.142:0/863034657 learned_addr learned my addr 172.21.15.142:0/863034657 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f82c4e00640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82c00b5f00 0x7f82c014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f82c4e00640 1 -- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c0147ce0 msgr2=0x7f82c01e55c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f82c4e00640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c0147ce0 0x7f82c01e55c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f82c4e00640 1 -- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c0141b70 msgr2=0x7f82c01444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f82c4e00640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c0141b70 0x7f82c01444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.668+0000 7f82c4e00640 1 -- 172.21.15.142:0/863034657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c01e4b00 con 0x7f82c00b5f00 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.669+0000 7f82c4e00640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82c00b5f00 0x7f82c014a2d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f82b8032000 tx=0x7f82b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.669+0000 7f82bcc00640 1 -- 172.21.15.142:0/863034657 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8054020 con 0x7f82c00b5f00 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.669+0000 7f82bcc00640 1 -- 172.21.15.142:0/863034657 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b804f460 con 0x7f82c00b5f00 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.669+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c01e4de0 con 0x7f82c00b5f00 2024-04-01T15:22:05.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.669+0000 7f82bcc00640 1 -- 172.21.15.142:0/863034657 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b804f850 con 0x7f82c00b5f00 2024-04-01T15:22:05.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.669+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c0144e20 con 0x7f82c00b5f00 2024-04-01T15:22:05.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.670+0000 7fa2b3e00640 1 -- 172.21.15.142:0/2845675525 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a0031640 con 0x7fa2b414f400 2024-04-01T15:22:05.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.670+0000 7fa2b3e00640 1 -- 172.21.15.142:0/2845675525 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a002d040 con 0x7fa2b414f400 2024-04-01T15:22:05.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.670+0000 7f117a400640 1 Processor -- start 2024-04-01T15:22:05.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.670+0000 7f6ba5600640 1 Processor -- start 2024-04-01T15:22:05.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.671+0000 7f4786400640 1 -- 172.21.15.142:0/3665388505 shutdown_connections 2024-04-01T15:22:05.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.671+0000 7f6ba5600640 1 -- start start 2024-04-01T15:22:05.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.671+0000 7f117a400640 1 -- start start 2024-04-01T15:22:05.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.671+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb894147080 con 0x7fb8780037a0 2024-04-01T15:22:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.670+0000 7ff96d400640 1 -- 172.21.15.142:0/914646875 wait complete. 2024-04-01T15:22:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7ff96d400640 1 Processor -- start 2024-04-01T15:22:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7ff96d400640 1 -- start start 2024-04-01T15:22:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7f117a400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11740aed40 0x7f1174140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7f117a400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11740b1d70 0x7f117413c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7f117a400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1174148600 0x7f117413db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7f117a400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f11740b1140 con 0x7f1174148600 2024-04-01T15:22:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7f117a400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f11740adee0 con 0x7f11740aed40 2024-04-01T15:22:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7f117a400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f11740b0e10 con 0x7f11740b1d70 2024-04-01T15:22:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7fa2bc600640 1 -- 172.21.15.142:0/2845675525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b414f400 msgr2=0x7fa2b4072c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7fa2bc600640 1 --2- 172.21.15.142:0/2845675525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b414f400 0x7fa2b4072c60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009870 tx=0x7fa2a002b8f0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7f4786400640 1 -- 172.21.15.142:0/3665388505 wait complete. 2024-04-01T15:22:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f1173400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11740aed40 0x7f1174140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f1172a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11740b1d70 0x7f117413c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f6ba5600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b840053c0 0x7f6ba0143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f6ba5600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ba0130120 0x7f6ba0149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f6ba5600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ba0131580 0x7f6ba0131a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f1173e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1174148600 0x7f117413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f1173400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11740aed40 0x7f1174140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:56972/0 (socket says 172.21.15.142:56972) 2024-04-01T15:22:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f1173400640 1 -- 172.21.15.142:0/2658830008 learned_addr learned my addr 172.21.15.142:0/2658830008 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.672+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c0068710 con 0x7f82c00b5f00 2024-04-01T15:22:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f6b9fe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b840053c0 0x7f6ba0143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f6b9fe00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b840053c0 0x7f6ba0143380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:56986/0 (socket says 172.21.15.142:56986) 2024-04-01T15:22:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f1173400640 1 -- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11740b1d70 msgr2=0x7f117413c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f1173400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11740b1d70 0x7f117413c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f1173400640 1 -- 172.21.15.142:0/2658830008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1174148600 msgr2=0x7f117413db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f1173400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1174148600 0x7f117413db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f1173400640 1 -- 172.21.15.142:0/2658830008 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117413cae0 con 0x7f11740aed40 2024-04-01T15:22:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f1173e00640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1174148600 0x7f117413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f6ba4c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ba0131580 0x7f6ba0131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7f6b9f400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ba0130120 0x7f6ba0149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f6b9fe00640 1 -- 172.21.15.142:0/690791047 learned_addr learned my addr 172.21.15.142:0/690791047 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba00b50c0 con 0x7f6ba0131580 2024-04-01T15:22:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7ff96d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96806d8d0 0x7ff9681e54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba00b4f40 con 0x7f6b840053c0 2024-04-01T15:22:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba00b4a10 con 0x7f6ba0130120 2024-04-01T15:22:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.673+0000 7fb88b400640 1 -- 172.21.15.142:0/3127893418 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb88001a070 con 0x7fb8780037a0 2024-04-01T15:22:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f1173400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11740aed40 0x7f1174140c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f116400b4d0 tx=0x7f116400b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f4786400640 1 Processor -- start 2024-04-01T15:22:05.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7fa2bc600640 1 -- 172.21.15.142:0/2845675525 shutdown_connections 2024-04-01T15:22:05.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7fa2bc600640 1 --2- 172.21.15.142:0/2845675525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b414f400 0x7fa2b4072c60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7fa2bc600640 1 --2- 172.21.15.142:0/2845675525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b406b790 0x7fa2b40b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7fa2bc600640 1 -- 172.21.15.142:0/2845675525 >> 172.21.15.142:0/2845675525 conn(0x7fa2b40ba370 msgr2=0x7fa2b40ba780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:05.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7fb88b400640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb87406c8f0 0x7fb87406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7ff96d400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9680af030 0x7ff968145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7ff96d400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9680b3ea0 0x7ff968145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f4786400640 1 -- start start 2024-04-01T15:22:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f6b9fe00640 1 -- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ba0130120 msgr2=0x7f6ba0149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f6b9fe00640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ba0130120 0x7f6ba0149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f6b9fe00640 1 -- 172.21.15.142:0/690791047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ba0131580 msgr2=0x7f6ba0131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f116b400640 1 -- 172.21.15.142:0/2658830008 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164014070 con 0x7f11740aed40 2024-04-01T15:22:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7ff96d400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff9680b53d0 con 0x7ff96806d8d0 2024-04-01T15:22:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117413e4d0 con 0x7f11740aed40 2024-04-01T15:22:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f116b400640 1 -- 172.21.15.142:0/2658830008 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1164010870 con 0x7f11740aed40 2024-04-01T15:22:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7fb88b400640 1 -- 172.21.15.142:0/3127893418 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb88008af60 con 0x7fb8780037a0 2024-04-01T15:22:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7ff96d400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff9680b03c0 con 0x7ff9680af030 2024-04-01T15:22:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7ff96d400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff9680afd70 con 0x7ff9680b3ea0 2024-04-01T15:22:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f116b400640 1 -- 172.21.15.142:0/2658830008 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164010c60 con 0x7f11740aed40 2024-04-01T15:22:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7f6b9fe00640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ba0131580 0x7f6ba0131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.676+0000 7f6b9fe00640 1 -- 172.21.15.142:0/690791047 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba006fb30 con 0x7f6b840053c0 2024-04-01T15:22:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.676+0000 7f6ba4c00640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ba0131580 0x7f6ba0131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:22:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.675+0000 7ff966800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96806d8d0 0x7ff9681e54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.676+0000 7ff966800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96806d8d0 0x7ff9681e54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51262/0 (socket says 172.21.15.142:51262) 2024-04-01T15:22:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.676+0000 7ff966800640 1 -- 172.21.15.142:0/3986129284 learned_addr learned my addr 172.21.15.142:0/3986129284 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.676+0000 7f6b9fe00640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b840053c0 0x7f6ba0143380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000d4f0 tx=0x7f6b9000d9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.676+0000 7f6b97e00640 1 -- 172.21.15.142:0/690791047 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90005cc0 con 0x7f6b840053c0 2024-04-01T15:22:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.674+0000 7f82bcc00640 1 -- 172.21.15.142:0/863034657 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82b8057020 con 0x7f82c00b5f00 2024-04-01T15:22:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba01438c0 con 0x7f6b840053c0 2024-04-01T15:22:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.676+0000 7f4786400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47800b5fd0 0x7f478013cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f4786400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800bda60 0x7f47801e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f4786400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f478014b610 0x7f4780140620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117413ee50 con 0x7f11740aed40 2024-04-01T15:22:05.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7fa2bc600640 1 -- 172.21.15.142:0/2845675525 shutdown_connections 2024-04-01T15:22:05.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f6b97e00640 1 -- 172.21.15.142:0/690791047 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b90017070 con 0x7f6b840053c0 2024-04-01T15:22:05.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f6b97e00640 1 -- 172.21.15.142:0/690791047 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90005e60 con 0x7f6b840053c0 2024-04-01T15:22:05.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f4786400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f47800b49c0 con 0x7f47800bda60 2024-04-01T15:22:05.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f4786400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f478014ba10 con 0x7f478014b610 2024-04-01T15:22:05.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f4786400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f47800b4b40 con 0x7f47800b5fd0 2024-04-01T15:22:05.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f477ea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800bda60 0x7f47801e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f477ea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800bda60 0x7f47801e4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51268/0 (socket says 172.21.15.142:51268) 2024-04-01T15:22:05.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7f477ea00640 1 -- 172.21.15.142:0/50852828 learned_addr learned my addr 172.21.15.142:0/50852828 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7ff966800640 1 -- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9680b3ea0 msgr2=0x7ff968145880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T15:22:05.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7ff966800640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9680b3ea0 0x7ff968145880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7ff966800640 1 -- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9680af030 msgr2=0x7ff968145340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T15:22:05.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7ff966800640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9680af030 0x7ff968145340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7ff966800640 1 -- 172.21.15.142:0/3986129284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96809ac50 con 0x7ff96806d8d0 2024-04-01T15:22:05.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7ff966800640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96806d8d0 0x7ff9681e54f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff950000c00 tx=0x7ff9500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7f82bcc00640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f82a006c8f0 0x7f82a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7fb892000640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb87406c8f0 0x7fb87406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7f477ea00640 1 -- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47800b5fd0 msgr2=0x7f478013cd50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T15:22:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7f477ea00640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47800b5fd0 0x7f478013cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7f477ea00640 1 -- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f478014b610 msgr2=0x7f4780140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7f477ea00640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f478014b610 0x7f4780140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7f477ea00640 1 -- 172.21.15.142:0/50852828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47800b2fb0 con 0x7f47800bda60 2024-04-01T15:22:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba0141260 con 0x7f6b840053c0 2024-04-01T15:22:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.678+0000 7f82bcc00640 1 -- 172.21.15.142:0/863034657 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82b80bf370 con 0x7f82c00b5f00 2024-04-01T15:22:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.677+0000 7fa2bc600640 1 -- 172.21.15.142:0/2845675525 wait complete. 2024-04-01T15:22:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.679+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1174068710 con 0x7f11740aed40 2024-04-01T15:22:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.679+0000 7f82bfe00640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f82a006c8f0 0x7f82a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.679+0000 7f116b400640 1 -- 172.21.15.142:0/2658830008 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1164017070 con 0x7f11740aed40 2024-04-01T15:22:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.679+0000 7f477ea00640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800bda60 0x7f47801e4e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4778036040 tx=0x7f4778004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.679+0000 7fb892000640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb87406c8f0 0x7fb87406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb884034000 tx=0x7fb884009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.680+0000 7fa2bc600640 1 Processor -- start 2024-04-01T15:22:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.680+0000 7fa2bc600640 1 -- start start 2024-04-01T15:22:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.681+0000 7f116b400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f115406c8f0 0x7f115406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.680+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba0146460 con 0x7f6b840053c0 2024-04-01T15:22:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.681+0000 7f116b400640 1 -- 172.21.15.142:0/2658830008 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f116408b8c0 con 0x7f11740aed40 2024-04-01T15:22:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.681+0000 7f1172a00640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f115406c8f0 0x7f115406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.681+0000 7f82bfe00640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f82a006c8f0 0x7f82a006edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82ac007fd0 tx=0x7f82ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.681+0000 7ff95ea00640 1 -- 172.21.15.142:0/3986129284 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff950031ed0 con 0x7ff96806d8d0 2024-04-01T15:22:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7f4777400640 1 -- 172.21.15.142:0/50852828 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778043020 con 0x7f47800bda60 2024-04-01T15:22:05.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7f4777400640 1 -- 172.21.15.142:0/50852828 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477803e450 con 0x7f47800bda60 2024-04-01T15:22:05.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7f4777400640 1 -- 172.21.15.142:0/50852828 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778009510 con 0x7f47800bda60 2024-04-01T15:22:05.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47801499b0 con 0x7f47800bda60 2024-04-01T15:22:05.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7fa2bc600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b406b790 0x7fa2b409c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9681e5d30 con 0x7ff96806d8d0 2024-04-01T15:22:05.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff968148430 con 0x7ff96806d8d0 2024-04-01T15:22:05.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7fa2bc600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b40731a0 0x7fa2b4072210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4780149ed0 con 0x7f47800bda60 2024-04-01T15:22:05.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7fa2bc600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b414f400 0x7fa2b41ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.683+0000 7fa2bc600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b40af3f0 con 0x7fa2b406b790 2024-04-01T15:22:05.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.683+0000 7fa2bc600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b40b1030 con 0x7fa2b414f400 2024-04-01T15:22:05.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.683+0000 7fa2b9c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b406b790 0x7fa2b409c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.683+0000 7ff95ea00640 1 -- 172.21.15.142:0/3986129284 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff950032860 con 0x7ff96806d8d0 2024-04-01T15:22:05.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.683+0000 7fa2b9c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b406b790 0x7fa2b409c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51270/0 (socket says 172.21.15.142:51270) 2024-04-01T15:22:05.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.683+0000 7fa2b9c00640 1 -- 172.21.15.142:0/2950840349 learned_addr learned my addr 172.21.15.142:0/2950840349 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4758005290 con 0x7f47800bda60 2024-04-01T15:22:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7f82bcc00640 1 -- 172.21.15.142:0/863034657 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f82b805e030 con 0x7f82c00b5f00 2024-04-01T15:22:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7f1172a00640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f115406c8f0 0x7f115406edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f117406e500 tx=0x7f1160009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7fb88b400640 1 -- 172.21.15.142:0/3127893418 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb894147080 con 0x7fb8780037a0 2024-04-01T15:22:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.681+0000 7f6b97e00640 1 -- 172.21.15.142:0/690791047 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b90007290 con 0x7f6b840053c0 2024-04-01T15:22:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7f6b97e00640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6b8006c920 0x7f6b8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.682+0000 7f6b97e00640 1 -- 172.21.15.142:0/690791047 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6b9008b800 con 0x7f6b840053c0 2024-04-01T15:22:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.683+0000 7ff95ea00640 1 -- 172.21.15.142:0/3986129284 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff950032c30 con 0x7ff96806d8d0 2024-04-01T15:22:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.683+0000 7fa2ba600640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b414f400 0x7fa2b41ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.683+0000 7fa2b9200640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b40731a0 0x7fa2b4072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b40af570 con 0x7fa2b40731a0 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7fa2b9200640 1 -- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b414f400 msgr2=0x7fa2b41ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7fa2b9200640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b414f400 0x7fa2b41ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7fa2b9200640 1 -- 172.21.15.142:0/2950840349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b406b790 msgr2=0x7fa2b409c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7fa2b9200640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b406b790 0x7fa2b409c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.684+0000 7fa2b9200640 1 -- 172.21.15.142:0/2950840349 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b409f2d0 con 0x7fa2b40731a0 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.685+0000 7fa2b9200640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b40731a0 0x7fa2b4072210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0033000 tx=0x7fa2a00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.685+0000 7fa2b1600640 1 -- 172.21.15.142:0/2950840349 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0040070 con 0x7fa2b40731a0 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.685+0000 7fa2b1600640 1 -- 172.21.15.142:0/2950840349 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a0039c30 con 0x7fa2b40731a0 2024-04-01T15:22:05.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.686+0000 7f6b9f400640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6b8006c920 0x7f6b8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.685+0000 7fa2b1600640 1 -- 172.21.15.142:0/2950840349 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0035040 con 0x7fa2b40731a0 2024-04-01T15:22:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.686+0000 7fa2ba600640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b414f400 0x7fa2b41ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.686+0000 7fa2b9c00640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b406b790 0x7fa2b409c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.686+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b409f5b0 con 0x7fa2b40731a0 2024-04-01T15:22:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.686+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b41ed470 con 0x7fa2b40731a0 2024-04-01T15:22:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.687+0000 7f6b9f400640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6b8006c920 0x7f6b8006ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00ba4a0 tx=0x7f6b8c0015f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.686+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9680b2dc0 con 0x7ff96806d8d0 2024-04-01T15:22:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.686+0000 7ff95ea00640 1 -- 172.21.15.142:0/3986129284 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff95004d3f0 con 0x7ff96806d8d0 2024-04-01T15:22:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.687+0000 7ff95ea00640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff94406c920 0x7ff94406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.688+0000 7f4777400640 1 -- 172.21.15.142:0/50852828 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4778046020 con 0x7f47800bda60 2024-04-01T15:22:05.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.687+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa290005290 con 0x7fa2b40731a0 2024-04-01T15:22:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.688+0000 7ff95ea00640 1 -- 172.21.15.142:0/3986129284 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff9500ad7e0 con 0x7ff96806d8d0 2024-04-01T15:22:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.688+0000 7ff965e00640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff94406c920 0x7ff94406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.689+0000 7ff965e00640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff94406c920 0x7ff94406ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff958000f60 tx=0x7ff9580079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.689+0000 7f4777400640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f476006c9c0 0x7f476006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.689+0000 7f4777400640 1 -- 172.21.15.142:0/50852828 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f47780ae670 con 0x7f47800bda60 2024-04-01T15:22:05.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.690+0000 7f477f400640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f476006c9c0 0x7f476006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.690+0000 7f116b400640 1 -- 172.21.15.142:0/2658830008 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1164059690 con 0x7f11740aed40 2024-04-01T15:22:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.690+0000 7fa2b1600640 1 -- 172.21.15.142:0/2950840349 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2a004b060 con 0x7fa2b40731a0 2024-04-01T15:22:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.692+0000 7fa2b1600640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa29406c8f0 0x7fa29406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:05.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.691+0000 7f477f400640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f476006c9c0 0x7f476006ee80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f476c000f60 tx=0x7f476c007a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.692+0000 7fa2b1600640 1 -- 172.21.15.142:0/2950840349 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa2a00ad940 con 0x7fa2b40731a0 2024-04-01T15:22:05.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.693+0000 7fa2b9c00640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa29406c8f0 0x7fa29406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:05.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.693+0000 7f4777400640 1 -- 172.21.15.142:0/50852828 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f477804d030 con 0x7f47800bda60 2024-04-01T15:22:05.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.694+0000 7fa2b9c00640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa29406c8f0 0x7fa29406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa2b41de690 tx=0x7fa2a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:05.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.702+0000 7ff95ea00640 1 -- 172.21.15.142:0/3986129284 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff9680b2dc0 con 0x7ff96806d8d0 2024-04-01T15:22:05.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.716+0000 7f6b97e00640 1 -- 172.21.15.142:0/690791047 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6ba0146460 con 0x7f6b840053c0 2024-04-01T15:22:05.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:05.716+0000 7fa2b1600640 1 -- 172.21.15.142:0/2950840349 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa2a007be00 con 0x7fa2b40731a0 2024-04-01T15:22:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.087+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb8940ba9a0 con 0x7fb8780037a0 2024-04-01T15:22:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.088+0000 7fb88b400640 1 -- 172.21.15.142:0/3127893418 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8940ba9a0 con 0x7fb8780037a0 2024-04-01T15:22:06.090 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2024-04-01T15:22:06.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.090+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe54c0b8630 con 0x7fe54c0b4750 2024-04-01T15:22:06.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.091+0000 7fe543400640 1 -- 172.21.15.142:0/2040994047 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe54407be80 con 0x7fe54c0b4750 2024-04-01T15:22:06.092 INFO:teuthology.orchestra.run.smithi142.stdout:55834574855 2024-04-01T15:22:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.091+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb87406c8f0 msgr2=0x7fb87406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.092+0000 7fb899e00640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb87406c8f0 0x7fb87406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb884034000 tx=0x7fb884009030 comp rx=0 tx=0).stop 2024-04-01T15:22:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.092+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 msgr2=0x7fb8940aa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.092+0000 7fb899e00640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb8940aa9f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb88000c730 tx=0x7fb88000cbf0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.092+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 shutdown_connections 2024-04-01T15:22:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.092+0000 7fb899e00640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb87406c8f0 0x7fb87406edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.092+0000 7fb899e00640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8941dc050 0x7fb8941dc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.092+0000 7fb899e00640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb894072530 0x7fb8940a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.092+0000 7fb899e00640 1 --2- 172.21.15.142:0/3127893418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8780037a0 0x7fb8940aa9f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.092+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 >> 172.21.15.142:0/3127893418 conn(0x7fb8940b9b50 msgr2=0x7fb8940bd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.093+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 shutdown_connections 2024-04-01T15:22:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.093+0000 7fb899e00640 1 -- 172.21.15.142:0/3127893418 wait complete. 2024-04-01T15:22:06.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.094+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe52c06c940 msgr2=0x7fe52c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.094+0000 7fe552200640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe52c06c940 0x7fe52c06ee00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe54c144600 tx=0x7fe53c008040 comp rx=0 tx=0).stop 2024-04-01T15:22:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.095+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 msgr2=0x7fe54c1e4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.095+0000 7fe552200640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 0x7fe54c1e4d70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe544000f80 tx=0x7fe544004a40 comp rx=0 tx=0).stop 2024-04-01T15:22:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.095+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 shutdown_connections 2024-04-01T15:22:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.095+0000 7fe552200640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe52c06c940 0x7fe52c06ee00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.095+0000 7fe552200640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe54c149170 0x7fe54c1e52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.095+0000 7fe552200640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54c0b4750 0x7fe54c1e4d70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.095+0000 7fe552200640 1 --2- 172.21.15.142:0/2040994047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe54c06d7c0 0x7fe54c0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.095+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 >> 172.21.15.142:0/2040994047 conn(0x7fe54c0b5790 msgr2=0x7fe54c0b5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:06.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.096+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 shutdown_connections 2024-04-01T15:22:06.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.096+0000 7fe552200640 1 -- 172.21.15.142:0/2040994047 wait complete. 2024-04-01T15:22:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.102+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f11740ae250 con 0x7f11740aed40 2024-04-01T15:22:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.103+0000 7f116b400640 1 -- 172.21.15.142:0/2658830008 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f116405d990 con 0x7f11740aed40 2024-04-01T15:22:06.104 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-04-01T15:22:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f115406c8f0 msgr2=0x7f115406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f115406c8f0 0x7f115406edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f117406e500 tx=0x7f1160009040 comp rx=0 tx=0).stop 2024-04-01T15:22:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11740aed40 msgr2=0x7f1174140c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11740aed40 0x7f1174140c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f116400b4d0 tx=0x7f116400b990 comp rx=0 tx=0).stop 2024-04-01T15:22:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 shutdown_connections 2024-04-01T15:22:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f115406c8f0 0x7f115406edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1174148600 0x7f117413db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11740b1d70 0x7f117413c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 --2- 172.21.15.142:0/2658830008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11740aed40 0x7f1174140c20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.108+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 >> 172.21.15.142:0/2658830008 conn(0x7f11740b6c90 msgr2=0x7f1174067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.109+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 shutdown_connections 2024-04-01T15:22:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.109+0000 7f117a400640 1 -- 172.21.15.142:0/2658830008 wait complete. 2024-04-01T15:22:06.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-04-01T15:22:06.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.123+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f82c01468d0 con 0x7f82c00b5f00 2024-04-01T15:22:06.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.124+0000 7f82bcc00640 1 -- 172.21.15.142:0/863034657 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82b808d710 con 0x7f82c00b5f00 2024-04-01T15:22:06.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-04-01T15:22:06.126 INFO:teuthology.orchestra.run.smithi142.stdout:55834574855 2024-04-01T15:22:06.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f82a006c8f0 msgr2=0x7f82a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f82a006c8f0 0x7f82a006edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82ac007fd0 tx=0x7f82ac009040 comp rx=0 tx=0).stop 2024-04-01T15:22:06.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82c00b5f00 msgr2=0x7f82c014a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82c00b5f00 0x7f82c014a2d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f82b8032000 tx=0x7f82b8004a40 comp rx=0 tx=0).stop 2024-04-01T15:22:06.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 shutdown_connections 2024-04-01T15:22:06.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f82a006c8f0 0x7f82a006edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c0147ce0 0x7f82c01e55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c0141b70 0x7f82c01444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 --2- 172.21.15.142:0/863034657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82c00b5f00 0x7f82c014a2d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.127+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 >> 172.21.15.142:0/863034657 conn(0x7f82c00bd100 msgr2=0x7f82c00b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:06.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.128+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 shutdown_connections 2024-04-01T15:22:06.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.128+0000 7f82c7800640 1 -- 172.21.15.142:0/863034657 wait complete. 2024-04-01T15:22:06.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.129+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff968068710 con 0x7ff96806d8d0 2024-04-01T15:22:06.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.129+0000 7ff95ea00640 1 -- 172.21.15.142:0/3986129284 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff950040070 con 0x7ff96806d8d0 2024-04-01T15:22:06.131 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-04-01T15:22:06.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.131+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa290005850 con 0x7fa2b40731a0 2024-04-01T15:22:06.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.132+0000 7fa2b1600640 1 -- 172.21.15.142:0/2950840349 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa2a007b700 con 0x7fa2b40731a0 2024-04-01T15:22:06.134 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-04-01T15:22:06.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4758005850 con 0x7f47800bda60 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff94406c920 msgr2=0x7ff94406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff94406c920 0x7ff94406ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff958000f60 tx=0x7ff9580079b0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96806d8d0 msgr2=0x7ff9681e54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96806d8d0 0x7ff9681e54f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff950000c00 tx=0x7ff9500046c0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 shutdown_connections 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff94406c920 0x7ff94406ede0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff958000f60 tx=0x7ff9580079b0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9680b3ea0 0x7ff968145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9680af030 0x7ff968145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 --2- 172.21.15.142:0/3986129284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96806d8d0 0x7ff9681e54f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 >> 172.21.15.142:0/3986129284 conn(0x7ff9680b5890 msgr2=0x7ff96806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:06.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.133+0000 7f4777400640 1 -- 172.21.15.142:0/50852828 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f477807cc30 con 0x7f47800bda60 2024-04-01T15:22:06.136 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-04-01T15:22:06.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-04-01T15:22:06.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.136+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 shutdown_connections 2024-04-01T15:22:06.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.136+0000 7ff96d400640 1 -- 172.21.15.142:0/3986129284 wait complete. 2024-04-01T15:22:06.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa29406c8f0 msgr2=0x7fa29406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa29406c8f0 0x7fa29406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa2b41de690 tx=0x7fa2a8008040 comp rx=0 tx=0).stop 2024-04-01T15:22:06.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b40731a0 msgr2=0x7fa2b4072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b40731a0 0x7fa2b4072210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0033000 tx=0x7fa2a00046c0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 shutdown_connections 2024-04-01T15:22:06.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa29406c8f0 0x7fa29406edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b414f400 0x7fa2b41ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2b40731a0 0x7fa2b4072210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 --2- 172.21.15.142:0/2950840349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2b406b790 0x7fa2b409c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 >> 172.21.15.142:0/2950840349 conn(0x7fa2b40ba370 msgr2=0x7fa2b414df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:06.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f476006c9c0 msgr2=0x7f476006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f476006c9c0 0x7f476006ee80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f476c000f60 tx=0x7f476c007a00 comp rx=0 tx=0).stop 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800bda60 msgr2=0x7f47801e4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800bda60 0x7f47801e4e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4778036040 tx=0x7f4778004a40 comp rx=0 tx=0).stop 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 shutdown_connections 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f476006c9c0 0x7f476006ee80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f478014b610 0x7f4780140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800bda60 0x7f47801e4e70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 --2- 172.21.15.142:0/50852828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47800b5fd0 0x7f478013cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 >> 172.21.15.142:0/50852828 conn(0x7f47800734b0 msgr2=0x7f47800b9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 shutdown_connections 2024-04-01T15:22:06.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7fa2bc600640 1 -- 172.21.15.142:0/2950840349 wait complete. 2024-04-01T15:22:06.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 shutdown_connections 2024-04-01T15:22:06.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.137+0000 7f4786400640 1 -- 172.21.15.142:0/50852828 wait complete. 2024-04-01T15:22:06.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.144+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6ba00b5400 con 0x7f6b840053c0 2024-04-01T15:22:06.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.145+0000 7f6b97e00640 1 -- 172.21.15.142:0/690791047 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ba00b5400 con 0x7f6b840053c0 2024-04-01T15:22:06.147 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6b8006c920 msgr2=0x7f6b8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6b8006c920 0x7f6b8006ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00ba4a0 tx=0x7f6b8c0015f0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b840053c0 msgr2=0x7f6ba0143380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b840053c0 0x7f6ba0143380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000d4f0 tx=0x7f6b9000d9b0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 shutdown_connections 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6b8006c920 0x7f6b8006ede0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ba0131580 0x7f6ba0131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ba0130120 0x7f6ba0149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 --2- 172.21.15.142:0/690791047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b840053c0 0x7f6ba0143380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.149+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 >> 172.21.15.142:0/690791047 conn(0x7f6ba0074ae0 msgr2=0x7f6ba0067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.150+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 shutdown_connections 2024-04-01T15:22:06.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:06.150+0000 7f6ba5600640 1 -- 172.21.15.142:0/690791047 wait complete. 2024-04-01T15:22:06.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-04-01T15:22:06.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-04-01T15:22:06.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-04-01T15:22:06.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-04-01T15:22:06.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-04-01T15:22:07.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-01T15:22:07.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-01T15:22:07.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-01T15:22:07.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-01T15:22:07.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-01T15:22:07.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-01T15:22:07.164 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-01T15:22:07.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-01T15:22:07.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.389+0000 7f2a8d800640 1 Processor -- start 2024-04-01T15:22:07.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.390+0000 7f2a8d800640 1 -- start start 2024-04-01T15:22:07.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.391+0000 7f2a8d800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a881443b0 0x7f2a880b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.391+0000 7f2a8d800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 0x7f2a880add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.392+0000 7f2a87e00640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2a880b9200 0x7f2a88143ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.142:34410/0 (socket says 172.21.15.142:34410) 2024-04-01T15:22:07.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.392+0000 7f2a87e00640 1 -- 172.21.15.142:0/1834670564 learned_addr learned my addr 172.21.15.142:0/1834670564 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:07.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.392+0000 7f2a8d800640 1 -- 172.21.15.142:0/1834670564 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a880b95e0 con 0x7f2a880b9200 2024-04-01T15:22:07.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.393+0000 7f2a8ce00640 1 --2- 172.21.15.142:0/1834670564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 0x7f2a880add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.393+0000 7f2a8d800640 1 -- 172.21.15.142:0/1834670564 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2a880b3e80 con 0x7f2a881443b0 2024-04-01T15:22:07.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.393+0000 7f2a8d800640 1 -- 172.21.15.142:0/1834670564 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2a880b3830 con 0x7f2a880b4ec0 2024-04-01T15:22:07.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.393+0000 7f2a86a00640 1 -- 172.21.15.142:0/1834670564 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599029738 0 0) 0x7f2a880b95e0 con 0x7f2a880b9200 2024-04-01T15:22:07.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.393+0000 7f2a87400640 1 --2- 172.21.15.142:0/1834670564 >> v2:172.21.15.142:3300/0 conn(0x7f2a881443b0 0x7f2a880b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.395+0000 7f2a86a00640 1 -- 172.21.15.142:0/1834670564 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a6c003520 con 0x7f2a880b9200 2024-04-01T15:22:07.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.395+0000 7f2a87400640 1 -- 172.21.15.142:0/1834670564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 msgr2=0x7f2a880add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.395+0000 7f2a87400640 1 --2- 172.21.15.142:0/1834670564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 0x7f2a880add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.395+0000 7f2a87400640 1 -- 172.21.15.142:0/1834670564 >> v1:172.21.15.179:6789/0 conn(0x7f2a880b9200 legacy=0x7f2a88143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.395+0000 7f2a87400640 1 -- 172.21.15.142:0/1834670564 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a880b3b10 con 0x7f2a881443b0 2024-04-01T15:22:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.394+0000 7efeea600640 1 Processor -- start 2024-04-01T15:22:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.395+0000 7efeea600640 1 -- start start 2024-04-01T15:22:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.396+0000 7efeea600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efee40b9e50 0x7efee40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.396+0000 7efeea600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee4145cd0 0x7efee414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.396+0000 7efeea600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efee4146130 0x7efee414f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.397+0000 7efeea600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7efee40b4c60 con 0x7efee4146130 2024-04-01T15:22:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.397+0000 7efeea600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7efee40b5910 con 0x7efee40b9e50 2024-04-01T15:22:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.397+0000 7efeea600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efee40ba230 con 0x7efee4145cd0 2024-04-01T15:22:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.397+0000 7f2a8ce00640 1 --2- 172.21.15.142:0/1834670564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 0x7f2a880add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.397+0000 7efee9200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efee40b9e50 0x7efee40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.397+0000 7efee3e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee4145cd0 0x7efee414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.397+0000 7f2a87400640 1 --2- 172.21.15.142:0/1834670564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 0x7f2a880b4310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009d90 tx=0x7f2a8002e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4df73b7c0d1b3f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.398+0000 7efee9200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efee40b9e50 0x7efee40b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:57006/0 (socket says 172.21.15.142:57006) 2024-04-01T15:22:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.398+0000 7efee9200640 1 -- 172.21.15.142:0/1087086261 learned_addr learned my addr 172.21.15.142:0/1087086261 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.398+0000 7efee9c00640 1 --2- 172.21.15.142:0/1087086261 >> v2:172.21.15.142:3300/0 conn(0x7efee4146130 0x7efee414f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.398+0000 7f2a86a00640 1 -- 172.21.15.142:0/1834670564 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8003b070 con 0x7f2a881443b0 2024-04-01T15:22:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.399+0000 7f2a86a00640 1 -- 172.21.15.142:0/1834670564 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a80036440 con 0x7f2a881443b0 2024-04-01T15:22:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.399+0000 7f2a86a00640 1 -- 172.21.15.142:0/1834670564 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80036850 con 0x7f2a881443b0 2024-04-01T15:22:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.399+0000 7efee9c00640 1 -- 172.21.15.142:0/1087086261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee4145cd0 msgr2=0x7efee414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.399+0000 7efee9c00640 1 --2- 172.21.15.142:0/1087086261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee4145cd0 0x7efee414f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.399+0000 7efee9c00640 1 -- 172.21.15.142:0/1087086261 >> v2:172.21.15.179:3300/0 conn(0x7efee40b9e50 msgr2=0x7efee40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.399+0000 7efee9c00640 1 --2- 172.21.15.142:0/1087086261 >> v2:172.21.15.179:3300/0 conn(0x7efee40b9e50 0x7efee40b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.399+0000 7efee9c00640 1 -- 172.21.15.142:0/1087086261 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee40b5000 con 0x7efee4146130 2024-04-01T15:22:07.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.400+0000 7f2a8d800640 1 -- 172.21.15.142:0/1834670564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 msgr2=0x7f2a880b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.400+0000 7f2a8d800640 1 --2- 172.21.15.142:0/1834670564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 0x7f2a880b4310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009d90 tx=0x7f2a8002e0f0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.401+0000 7f2a8d800640 1 -- 172.21.15.142:0/1834670564 shutdown_connections 2024-04-01T15:22:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.401+0000 7f2a8d800640 1 --2- 172.21.15.142:0/1834670564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 0x7f2a880add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.401+0000 7f2a8d800640 1 --2- 172.21.15.142:0/1834670564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 0x7f2a880b4310 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.401+0000 7f2a8d800640 1 -- 172.21.15.142:0/1834670564 >> 172.21.15.142:0/1834670564 conn(0x7f2a8806c480 msgr2=0x7f2a8806c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.401+0000 7efee9c00640 1 --2- 172.21.15.142:0/1087086261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 0x7efee414f720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efee40b08d0 tx=0x7efedc02bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26be27fa816d68f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.401+0000 7efee3400640 1 -- 172.21.15.142:0/1087086261 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc039070 con 0x7efee4146130 2024-04-01T15:22:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.402+0000 7f2a8d800640 1 -- 172.21.15.142:0/1834670564 shutdown_connections 2024-04-01T15:22:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.402+0000 7f2a8d800640 1 -- 172.21.15.142:0/1834670564 wait complete. 2024-04-01T15:22:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.402+0000 7efee3400640 1 -- 172.21.15.142:0/1087086261 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efedc02cb00 con 0x7efee4146130 2024-04-01T15:22:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.402+0000 7efee3400640 1 -- 172.21.15.142:0/1087086261 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc034440 con 0x7efee4146130 2024-04-01T15:22:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.403+0000 7efeea600640 1 -- 172.21.15.142:0/1087086261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 msgr2=0x7efee414f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.403+0000 7efeea600640 1 --2- 172.21.15.142:0/1087086261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 0x7efee414f720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efee40b08d0 tx=0x7efedc02bd50 comp rx=0 tx=0).stop 2024-04-01T15:22:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.404+0000 7efeea600640 1 -- 172.21.15.142:0/1087086261 shutdown_connections 2024-04-01T15:22:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.404+0000 7efeea600640 1 --2- 172.21.15.142:0/1087086261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 0x7efee414f720 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.404+0000 7efeea600640 1 --2- 172.21.15.142:0/1087086261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee4145cd0 0x7efee414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.404+0000 7efeea600640 1 --2- 172.21.15.142:0/1087086261 >> v2:172.21.15.179:3300/0 conn(0x7efee40b9e50 0x7efee40b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.404+0000 7efeea600640 1 -- 172.21.15.142:0/1087086261 >> 172.21.15.142:0/1087086261 conn(0x7efee402c3d0 msgr2=0x7efee402c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.404+0000 7efeea600640 1 -- 172.21.15.142:0/1087086261 shutdown_connections 2024-04-01T15:22:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.405+0000 7efeea600640 1 -- 172.21.15.142:0/1087086261 wait complete. 2024-04-01T15:22:07.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.405+0000 7f2a8d800640 1 Processor -- start 2024-04-01T15:22:07.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.406+0000 7f2a8d800640 1 -- start start 2024-04-01T15:22:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.407+0000 7f2a8d800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 0x7f2a88147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.407+0000 7f2a8d800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a880b9200 0x7f2a880715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.407+0000 7f2a8d800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 0x7f2a8806f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.407+0000 7f2a8d800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2a880b35d0 con 0x7f2a881443b0 2024-04-01T15:22:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.407+0000 7f2a8d800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a880b3450 con 0x7f2a880b9200 2024-04-01T15:22:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.407+0000 7f2a8d800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2a8806cf70 con 0x7f2a880b4ec0 2024-04-01T15:22:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.408+0000 7efeea600640 1 Processor -- start 2024-04-01T15:22:07.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.408+0000 7f2a8ce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 0x7f2a8806f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.408+0000 7efeea600640 1 -- start start 2024-04-01T15:22:07.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.408+0000 7f2a8ce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 0x7f2a8806f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51304/0 (socket says 172.21.15.142:51304) 2024-04-01T15:22:07.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.408+0000 7f2a8ce00640 1 -- 172.21.15.142:0/1787813283 learned_addr learned my addr 172.21.15.142:0/1787813283 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.410+0000 7f2a8ce00640 1 -- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 msgr2=0x7f2a88147180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T15:22:07.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.410+0000 7f2a8ce00640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 0x7f2a88147180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.410+0000 7efeea600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee40b9e50 0x7efee40b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.410+0000 7f2a8ce00640 1 -- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a880b9200 msgr2=0x7f2a880715d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T15:22:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.410+0000 7f2a8ce00640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a880b9200 0x7f2a880715d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.410+0000 7efeea600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efee4145cd0 0x7efee40b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.410+0000 7f2a8ce00640 1 -- 172.21.15.142:0/1787813283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a88072110 con 0x7f2a881443b0 2024-04-01T15:22:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.410+0000 7efeea600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 0x7efee4071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.411+0000 7efee9200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee40b9e50 0x7efee40b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.411+0000 7efee9200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee40b9e50 0x7efee40b25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50446/0 (socket says 172.21.15.142:50446) 2024-04-01T15:22:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.411+0000 7efee3e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efee4145cd0 0x7efee40b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.411+0000 7efee3e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efee4145cd0 0x7efee40b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:57016/0 (socket says 172.21.15.142:57016) 2024-04-01T15:22:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.411+0000 7f2a8ce00640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 0x7f2a8806f6c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400e9c0 tx=0x7f2a7400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.411+0000 7f2a7fe00640 1 -- 172.21.15.142:0/1787813283 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74015030 con 0x7f2a881443b0 2024-04-01T15:22:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.412+0000 7f2a7fe00640 1 -- 172.21.15.142:0/1787813283 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7400ca60 con 0x7f2a881443b0 2024-04-01T15:22:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.412+0000 7f2a7fe00640 1 -- 172.21.15.142:0/1787813283 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74015030 con 0x7f2a881443b0 2024-04-01T15:22:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.412+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8809aba0 con 0x7f2a881443b0 2024-04-01T15:22:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.412+0000 7efee9c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 0x7efee4071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.412+0000 7efee9c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 0x7efee4071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51310/0 (socket says 172.21.15.142:51310) 2024-04-01T15:22:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.413+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7efee40b9590 con 0x7efee4146130 2024-04-01T15:22:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.413+0000 7efee9200640 1 -- 172.21.15.142:0/940293258 learned_addr learned my addr 172.21.15.142:0/940293258 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.413+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efee40b55a0 con 0x7efee4145cd0 2024-04-01T15:22:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.413+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efee40b9710 con 0x7efee40b9e50 2024-04-01T15:22:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.412+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a88070760 con 0x7f2a881443b0 2024-04-01T15:22:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.414+0000 7efee3e00640 1 -- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee40b9e50 msgr2=0x7efee40b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.414+0000 7efee3e00640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee40b9e50 0x7efee40b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.414+0000 7efee3e00640 1 -- 172.21.15.142:0/940293258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 msgr2=0x7efee4071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.415+0000 7efee3e00640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 0x7efee4071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.415+0000 7efee3e00640 1 -- 172.21.15.142:0/940293258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee41e16d0 con 0x7efee4145cd0 2024-04-01T15:22:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.415+0000 7efee9c00640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 0x7efee4071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.416+0000 7efee3e00640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efee4145cd0 0x7efee40b0c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efed400e870 tx=0x7efed400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.415+0000 7f2a7fe00640 1 -- 172.21.15.142:0/1787813283 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a74018030 con 0x7f2a881443b0 2024-04-01T15:22:07.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.417+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a88068590 con 0x7f2a881443b0 2024-04-01T15:22:07.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.416+0000 7efee0c00640 1 -- 172.21.15.142:0/940293258 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4017070 con 0x7efee4145cd0 2024-04-01T15:22:07.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.416+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee41e19b0 con 0x7efee4145cd0 2024-04-01T15:22:07.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.417+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee40b1180 con 0x7efee4145cd0 2024-04-01T15:22:07.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.418+0000 7efee0c00640 1 -- 172.21.15.142:0/940293258 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed400ee60 con 0x7efee4145cd0 2024-04-01T15:22:07.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.418+0000 7efee0c00640 1 -- 172.21.15.142:0/940293258 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4017070 con 0x7efee4145cd0 2024-04-01T15:22:07.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.420+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efebc005290 con 0x7efee4145cd0 2024-04-01T15:22:07.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.422+0000 7f2a7fe00640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2a6806caf0 0x7f2a6806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.422+0000 7f2a7fe00640 1 -- 172.21.15.142:0/1787813283 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2a7408b100 con 0x7f2a881443b0 2024-04-01T15:22:07.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.423+0000 7f2a87e00640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2a6806caf0 0x7f2a6806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.424+0000 7f2a87e00640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2a6806caf0 0x7f2a6806efb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a78000f60 tx=0x7f2a780010a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.423+0000 7efee0c00640 1 -- 172.21.15.142:0/940293258 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efed401a070 con 0x7efee4145cd0 2024-04-01T15:22:07.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.424+0000 7efee0c00640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7efec406caf0 0x7efec406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.424+0000 7efee0c00640 1 -- 172.21.15.142:0/940293258 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efed40576b0 con 0x7efee4145cd0 2024-04-01T15:22:07.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.425+0000 7efee9200640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7efec406caf0 0x7efec406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.426+0000 7efee9200640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7efec406caf0 0x7efec406efb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efed0009bb0 tx=0x7efed0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.430+0000 7f2a7fe00640 1 -- 172.21.15.142:0/1787813283 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2a740595c0 con 0x7f2a881443b0 2024-04-01T15:22:07.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.445+0000 7efee0c00640 1 -- 172.21.15.142:0/940293258 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efed4059610 con 0x7efee4145cd0 2024-04-01T15:22:07.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.458+0000 7fb68e200640 1 Processor -- start 2024-04-01T15:22:07.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.458+0000 7fb68e200640 1 -- start start 2024-04-01T15:22:07.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.460+0000 7fb68e200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6880ae020 0x7fb68806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.460+0000 7fb68e200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb6880af720 0x7fb688143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.460+0000 7fb68e200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb688144530 0x7fb688146f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.460+0000 7fb68e200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb6880ae400 con 0x7fb6880af720 2024-04-01T15:22:07.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.460+0000 7fb68e200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fb6880aec70 con 0x7fb688144530 2024-04-01T15:22:07.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.460+0000 7fb68e200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb6881449a0 con 0x7fb6880ae020 2024-04-01T15:22:07.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.461+0000 7fb687e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb688144530 0x7fb688146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.461+0000 7fb687e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb688144530 0x7fb688146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:57026/0 (socket says 172.21.15.142:57026) 2024-04-01T15:22:07.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.461+0000 7fb687e00640 1 -- 172.21.15.142:0/4059191905 learned_addr learned my addr 172.21.15.142:0/4059191905 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.462+0000 7fb686a00640 1 --2- 172.21.15.142:0/4059191905 >> v2:172.21.15.142:3300/0 conn(0x7fb6880af720 0x7fb688143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.462+0000 7fb687e00640 1 -- 172.21.15.142:0/4059191905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6880ae020 msgr2=0x7fb68806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.462+0000 7fb687e00640 1 --2- 172.21.15.142:0/4059191905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6880ae020 0x7fb68806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.462+0000 7fb687e00640 1 -- 172.21.15.142:0/4059191905 >> v2:172.21.15.142:3300/0 conn(0x7fb6880af720 msgr2=0x7fb688143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.462+0000 7fb687e00640 1 --2- 172.21.15.142:0/4059191905 >> v2:172.21.15.142:3300/0 conn(0x7fb6880af720 0x7fb688143ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.462+0000 7fb687e00640 1 -- 172.21.15.142:0/4059191905 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6880b08f0 con 0x7fb688144530 2024-04-01T15:22:07.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.462+0000 7fb686a00640 1 --2- 172.21.15.142:0/4059191905 >> v2:172.21.15.142:3300/0 conn(0x7fb6880af720 0x7fb688143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:22:07.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.463+0000 7f952b600640 1 Processor -- start 2024-04-01T15:22:07.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.464+0000 7f952b600640 1 -- start start 2024-04-01T15:22:07.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.465+0000 7fb687e00640 1 --2- 172.21.15.142:0/4059191905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb688144530 0x7fb688146f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb688073be0 tx=0x7fb67402b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46a5d6a048c53950 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.465+0000 7f952b600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95240af200 0x7f952414f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7fb686000640 1 -- 172.21.15.142:0/4059191905 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674038070 con 0x7fb688144530 2024-04-01T15:22:07.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7fb686000640 1 -- 172.21.15.142:0/4059191905 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb674031740 con 0x7fb688144530 2024-04-01T15:22:07.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7fb686000640 1 -- 172.21.15.142:0/4059191905 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67402f050 con 0x7fb688144530 2024-04-01T15:22:07.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7f9523e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95240af200 0x7f952414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7f9528c00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f952406d8d0 0x7f95240aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44336/0 (socket says 172.21.15.142:44336) 2024-04-01T15:22:07.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7f9523e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95240af200 0x7f952414f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51332/0 (socket says 172.21.15.142:51332) 2024-04-01T15:22:07.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7f9523e00640 1 -- 172.21.15.142:0/2017632810 learned_addr learned my addr 172.21.15.142:0/2017632810 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7f952b600640 1 -- 172.21.15.142:0/2017632810 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95240b56b0 con 0x7f952406d8d0 2024-04-01T15:22:07.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7f952b600640 1 -- 172.21.15.142:0/2017632810 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952406dcb0 con 0x7f952414f870 2024-04-01T15:22:07.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.466+0000 7f952b600640 1 -- 172.21.15.142:0/2017632810 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f95240ae660 con 0x7f95240af200 2024-04-01T15:22:07.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.467+0000 7f9523e00640 1 -- 172.21.15.142:0/2017632810 >> v1:172.21.15.179:6789/0 conn(0x7f952414f870 legacy=0x7f9524156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.467+0000 7f9523e00640 1 -- 172.21.15.142:0/2017632810 >> v1:172.21.15.142:6789/0 conn(0x7f952406d8d0 legacy=0x7f95240aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.467+0000 7f9523e00640 1 -- 172.21.15.142:0/2017632810 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95240ae050 con 0x7f95240af200 2024-04-01T15:22:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.467+0000 7fb68e200640 1 -- 172.21.15.142:0/4059191905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb688144530 msgr2=0x7fb688146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.467+0000 7fb68e200640 1 --2- 172.21.15.142:0/4059191905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb688144530 0x7fb688146f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb688073be0 tx=0x7fb67402b7e0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.468+0000 7fb68e200640 1 -- 172.21.15.142:0/4059191905 shutdown_connections 2024-04-01T15:22:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.468+0000 7fb68e200640 1 --2- 172.21.15.142:0/4059191905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb688144530 0x7fb688146f50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.468+0000 7fb68e200640 1 --2- 172.21.15.142:0/4059191905 >> v2:172.21.15.142:3300/0 conn(0x7fb6880af720 0x7fb688143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.468+0000 7fb68e200640 1 --2- 172.21.15.142:0/4059191905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6880ae020 0x7fb68806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.468+0000 7fb68e200640 1 -- 172.21.15.142:0/4059191905 >> 172.21.15.142:0/4059191905 conn(0x7fb6880b6c90 msgr2=0x7fb6880b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.469+0000 7fb68e200640 1 -- 172.21.15.142:0/4059191905 shutdown_connections 2024-04-01T15:22:07.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.469+0000 7fb68e200640 1 -- 172.21.15.142:0/4059191905 wait complete. 2024-04-01T15:22:07.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.470+0000 7f9523e00640 1 --2- 172.21.15.142:0/2017632810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95240af200 0x7f952414f330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9514009870 tx=0x7f951402b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7fbe3c2549c927 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.471+0000 7f13b4800640 1 Processor -- start 2024-04-01T15:22:07.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.471+0000 7f9523400640 1 -- 172.21.15.142:0/2017632810 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514037070 con 0x7f95240af200 2024-04-01T15:22:07.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.471+0000 7f9523400640 1 -- 172.21.15.142:0/2017632810 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9514030710 con 0x7f95240af200 2024-04-01T15:22:07.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.471+0000 7f9523400640 1 -- 172.21.15.142:0/2017632810 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514037070 con 0x7f95240af200 2024-04-01T15:22:07.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.472+0000 7fb68e200640 1 Processor -- start 2024-04-01T15:22:07.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.472+0000 7fb68e200640 1 -- start start 2024-04-01T15:22:07.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.472+0000 7f952b600640 1 -- 172.21.15.142:0/2017632810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95240af200 msgr2=0x7f952414f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.472+0000 7f952b600640 1 --2- 172.21.15.142:0/2017632810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95240af200 0x7f952414f330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9514009870 tx=0x7f951402b6d0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f952b600640 1 -- 172.21.15.142:0/2017632810 shutdown_connections 2024-04-01T15:22:07.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f952b600640 1 --2- 172.21.15.142:0/2017632810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95240af200 0x7f952414f330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f952b600640 1 -- 172.21.15.142:0/2017632810 >> 172.21.15.142:0/2017632810 conn(0x7f95240b5890 msgr2=0x7f95240b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f952b600640 1 -- 172.21.15.142:0/2017632810 shutdown_connections 2024-04-01T15:22:07.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f952b600640 1 -- 172.21.15.142:0/2017632810 wait complete. 2024-04-01T15:22:07.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.471+0000 7f13b4800640 1 -- start start 2024-04-01T15:22:07.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f13b4800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13a8036b50 0x7f13a80d4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f13b4800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f13b4800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13a8035420 con 0x7f13a80d1170 2024-04-01T15:22:07.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f13b4800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f13a80d0ce0 con 0x7f13a8036b50 2024-04-01T15:22:07.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.473+0000 7f13b4800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f13a8038370 con 0x7f13a80ca680 2024-04-01T15:22:07.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb68e200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6880ae020 0x7fb6881432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb68e200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6880af720 0x7fb688072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb68e200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb688144530 0x7fb6881423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb68e200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb6880af200 con 0x7fb6880af720 2024-04-01T15:22:07.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb68e200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6880aef20 con 0x7fb6880ae020 2024-04-01T15:22:07.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb68e200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb68806cb90 con 0x7fb688144530 2024-04-01T15:22:07.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb686a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6880af720 0x7fb688072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb686a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6880af720 0x7fb688072370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51354/0 (socket says 172.21.15.142:51354) 2024-04-01T15:22:07.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb686a00640 1 -- 172.21.15.142:0/2591098842 learned_addr learned my addr 172.21.15.142:0/2591098842 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.474+0000 7fb687e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb688144530 0x7fb6881423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.475+0000 7fb687400640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6880ae020 0x7fb6881432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.475+0000 7fb687400640 1 -- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb688144530 msgr2=0x7fb6881423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.475+0000 7fb687400640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb688144530 0x7fb6881423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.475+0000 7f13b1400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.475+0000 7f13b1e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13a8036b50 0x7f13a80d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.476+0000 7fb687400640 1 -- 172.21.15.142:0/2591098842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6880af720 msgr2=0x7fb688072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.476+0000 7fb687400640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6880af720 0x7fb688072370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.476+0000 7fb687400640 1 -- 172.21.15.142:0/2591098842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb688141bb0 con 0x7fb6880ae020 2024-04-01T15:22:07.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.476+0000 7fb686a00640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6880af720 0x7fb688072370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:07.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.476+0000 7f13b1e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13a8036b50 0x7f13a80d4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51344/0 (socket says 172.21.15.142:51344) 2024-04-01T15:22:07.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.476+0000 7f13b1e00640 1 -- 172.21.15.142:0/3204629026 learned_addr learned my addr 172.21.15.142:0/3204629026 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.476+0000 7f952b600640 1 Processor -- start 2024-04-01T15:22:07.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.476+0000 7fb687e00640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb688144530 0x7fb6881423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:07.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.475+0000 7f13b2800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f13a80d1170 0x7f13a8035800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44342/0 (socket says 172.21.15.142:44342) 2024-04-01T15:22:07.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.476+0000 7f952b600640 1 -- start start 2024-04-01T15:22:07.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.477+0000 7fb687400640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6880ae020 0x7fb6881432a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb68000bd70 tx=0x7fb68000be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.477+0000 7f13b1e00640 1 -- 172.21.15.142:0/3204629026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 msgr2=0x7f13a80cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.477+0000 7f13b1e00640 1 --2- 172.21.15.142:0/3204629026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.478+0000 7f952b600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f952406d8d0 0x7f952414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.477+0000 7fb67f400640 1 -- 172.21.15.142:0/2591098842 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680019070 con 0x7fb6880ae020 2024-04-01T15:22:07.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.477+0000 7fb67f400640 1 -- 172.21.15.142:0/2591098842 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb680014440 con 0x7fb6880ae020 2024-04-01T15:22:07.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.477+0000 7fb67f400640 1 -- 172.21.15.142:0/2591098842 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680014830 con 0x7fb6880ae020 2024-04-01T15:22:07.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.478+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb688140f70 con 0x7fb6880ae020 2024-04-01T15:22:07.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.478+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6881438f0 con 0x7fb6880ae020 2024-04-01T15:22:07.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.478+0000 7f9ffda00640 1 Processor -- start 2024-04-01T15:22:07.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.478+0000 7f952b600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95240af200 0x7f95240721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.477+0000 7f13b1e00640 1 -- 172.21.15.142:0/3204629026 >> v1:172.21.15.142:6789/0 conn(0x7f13a80d1170 legacy=0x7f13a8035800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.477+0000 7f13b1e00640 1 -- 172.21.15.142:0/3204629026 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a8036f30 con 0x7f13a8036b50 2024-04-01T15:22:07.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f952b600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952414f870 0x7f952414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.478+0000 7f9ffda00640 1 -- start start 2024-04-01T15:22:07.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f13b1e00640 1 --2- 172.21.15.142:0/3204629026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a8036b50 0x7f13a80d4440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f13ac06a940 tx=0x7f13ac0a6dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44b1fb8eef692c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f952b600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f95240afd70 con 0x7f952414f870 2024-04-01T15:22:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f4c47200640 1 Processor -- start 2024-04-01T15:22:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f13b0a00640 1 -- 172.21.15.142:0/3204629026 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac0b4070 con 0x7f13a8036b50 2024-04-01T15:22:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f952b600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f95240b03c0 con 0x7f952406d8d0 2024-04-01T15:22:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f13b0a00640 1 -- 172.21.15.142:0/3204629026 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ac0a7c30 con 0x7f13a8036b50 2024-04-01T15:22:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f4c47200640 1 -- start start 2024-04-01T15:22:07.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f13b0a00640 1 -- 172.21.15.142:0/3204629026 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac0af640 con 0x7f13a8036b50 2024-04-01T15:22:07.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f952b600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f95240b3210 con 0x7f95240af200 2024-04-01T15:22:07.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f9ffda00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80af970 0x7f9ff8143e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f9ffda00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ff806c4c0 0x7f9ff81443c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.481+0000 7f9ffda00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff80b50a0 con 0x7f9ff80b4cc0 2024-04-01T15:22:07.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.481+0000 7f9ffda00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff80ae150 con 0x7f9ff806c4c0 2024-04-01T15:22:07.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.481+0000 7f9ffda00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff8144900 con 0x7f9ff80af970 2024-04-01T15:22:07.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.481+0000 7f9ffd000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ff806c4c0 0x7f9ff81443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.482+0000 7f9ffd000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ff806c4c0 0x7f9ff81443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:57060/0 (socket says 172.21.15.142:57060) 2024-04-01T15:22:07.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.482+0000 7f13b4800640 1 -- 172.21.15.142:0/3204629026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a8036b50 msgr2=0x7f13a80d4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.482+0000 7f13b4800640 1 --2- 172.21.15.142:0/3204629026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a8036b50 0x7f13a80d4440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f13ac06a940 tx=0x7f13ac0a6dc0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.482+0000 7f9ffd000640 1 -- 172.21.15.142:0/2378892332 learned_addr learned my addr 172.21.15.142:0/2378892332 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f9528c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f952406d8d0 0x7f952414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f9528c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f952406d8d0 0x7f952414a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:57046/0 (socket says 172.21.15.142:57046) 2024-04-01T15:22:07.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f9528c00640 1 -- 172.21.15.142:0/439169635 learned_addr learned my addr 172.21.15.142:0/439169635 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f9523e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95240af200 0x7f95240721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.479+0000 7f9529600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952414f870 0x7f952414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f9529600640 1 -- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95240af200 msgr2=0x7f95240721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f9529600640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95240af200 0x7f95240721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f9529600640 1 -- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f952406d8d0 msgr2=0x7f952414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f9529600640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f952406d8d0 0x7f952414a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.480+0000 7f9529600640 1 -- 172.21.15.142:0/439169635 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952414b8e0 con 0x7f952414f870 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.481+0000 7f9529600640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952414f870 0x7f952414c2c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f951c00be00 tx=0x7f951c00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.481+0000 7f9523e00640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95240af200 0x7f95240721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.481+0000 7f9520c00640 1 -- 172.21.15.142:0/439169635 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c003970 con 0x7f952414f870 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.481+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9524071060 con 0x7f952414f870 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.481+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952414c9e0 con 0x7f952414f870 2024-04-01T15:22:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.482+0000 7f9520c00640 1 -- 172.21.15.142:0/439169635 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951c003b10 con 0x7f952414f870 2024-04-01T15:22:07.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.482+0000 7f9520c00640 1 -- 172.21.15.142:0/439169635 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c003970 con 0x7f952414f870 2024-04-01T15:22:07.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.482+0000 7fb67f400640 1 -- 172.21.15.142:0/2591098842 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb68001c070 con 0x7fb6880ae020 2024-04-01T15:22:07.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f13b4800640 1 -- 172.21.15.142:0/3204629026 shutdown_connections 2024-04-01T15:22:07.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f13b4800640 1 --2- 172.21.15.142:0/3204629026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f13b4800640 1 --2- 172.21.15.142:0/3204629026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a8036b50 0x7f13a80d4440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f13b4800640 1 -- 172.21.15.142:0/3204629026 >> 172.21.15.142:0/3204629026 conn(0x7f13a803abe0 msgr2=0x7f13a8005e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f9ff7400640 1 --2- 172.21.15.142:0/2378892332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80af970 0x7f9ff8143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f9ffd000640 1 -- 172.21.15.142:0/2378892332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80af970 msgr2=0x7f9ff8143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f13b4800640 1 -- 172.21.15.142:0/3204629026 shutdown_connections 2024-04-01T15:22:07.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f13b4800640 1 -- 172.21.15.142:0/3204629026 wait complete. 2024-04-01T15:22:07.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.482+0000 7f4c47200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014af70 0x7f4c4014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f4c47200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c400b9380 con 0x7f4c400b9ea0 2024-04-01T15:22:07.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f4c47200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c4014b910 con 0x7f4c4014fff0 2024-04-01T15:22:07.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f4c47200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4c400b6d70 con 0x7f4c4014af70 2024-04-01T15:22:07.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f9ffd000640 1 --2- 172.21.15.142:0/2378892332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80af970 0x7f9ff8143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.484+0000 7f4c46800640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4c4014fff0 0x7f4c401523e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.142:34430/0 (socket says 172.21.15.142:34430) 2024-04-01T15:22:07.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.484+0000 7f4c46800640 1 -- 172.21.15.142:0/680218854 learned_addr learned my addr 172.21.15.142:0/680218854 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:07.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.484+0000 7f4c45400640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014af70 0x7f4c4014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f9ffd000640 1 -- 172.21.15.142:0/2378892332 >> v1:172.21.15.142:6789/0 conn(0x7f9ff80b4cc0 legacy=0x7f9ff80af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.484+0000 7fb67f400640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb66806c920 0x7fb66806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.484+0000 7fb67f400640 1 -- 172.21.15.142:0/2591098842 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb68008b970 con 0x7fb6880ae020 2024-04-01T15:22:07.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.483+0000 7f9ffd000640 1 -- 172.21.15.142:0/2378892332 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff80b0560 con 0x7f9ff806c4c0 2024-04-01T15:22:07.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.484+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286333588 0 0) 0x7f4c4014b910 con 0x7f4c4014fff0 2024-04-01T15:22:07.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.484+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c2c003520 con 0x7f4c4014fff0 2024-04-01T15:22:07.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.485+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb660005290 con 0x7fb6880ae020 2024-04-01T15:22:07.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.485+0000 7fb686a00640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb66806c920 0x7fb66806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.485+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94fc005290 con 0x7f952414f870 2024-04-01T15:22:07.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1327113183 0 0) 0x7f4c2c003520 con 0x7f4c4014fff0 2024-04-01T15:22:07.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014af70 msgr2=0x7f4c4014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014af70 0x7f4c4014b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 >> v1:172.21.15.142:6789/0 conn(0x7f4c400b9ea0 legacy=0x7f4c40141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c400ba280 con 0x7f4c4014fff0 2024-04-01T15:22:07.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f4c3c001690 con 0x7f4c4014fff0 2024-04-01T15:22:07.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 >> v1:172.21.15.179:6789/0 conn(0x7f4c4014fff0 legacy=0x7f4c401523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f9ffd000640 1 --2- 172.21.15.142:0/2378892332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff806c4c0 0x7f9ff81443c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009870 tx=0x7f9fe402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b9969827b58b25f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c2c0039b0 0x7f4c2c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c2c0043d0 0x7f4c2c0048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c2c005140 0x7f4c2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f13b4800640 1 Processor -- start 2024-04-01T15:22:07.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400b6d70 con 0x7f4c2c0039b0 2024-04-01T15:22:07.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c00c010 con 0x7f4c2c0043d0 2024-04-01T15:22:07.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2c00c210 con 0x7f4c2c005140 2024-04-01T15:22:07.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f4c45400640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014af70 0x7f4c4014b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:22:07.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.487+0000 7f4c45400640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c2c0043d0 0x7f4c2c0048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.487+0000 7f4c46800640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c2c005140 0x7f4c2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f13b4800640 1 -- start start 2024-04-01T15:22:07.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.487+0000 7f4c45400640 1 -- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c2c005140 msgr2=0x7f4c2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.487+0000 7f4c45400640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c2c005140 0x7f4c2c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f4c45400640 1 -- 172.21.15.142:0/680218854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c2c0039b0 msgr2=0x7f4c2c003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T15:22:07.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f4c45400640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c2c0039b0 0x7f4c2c003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f4c45400640 1 -- 172.21.15.142:0/680218854 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c400ba280 con 0x7f4c2c0043d0 2024-04-01T15:22:07.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.487+0000 7f13b4800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8036b50 0x7f13a80d80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f13b4800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80d8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f13b4800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a80d1170 0x7f13a80d9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f13b4800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f13a80d4980 con 0x7f13a80d1170 2024-04-01T15:22:07.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f13b4800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13a80d4c80 con 0x7f13a8036b50 2024-04-01T15:22:07.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f13b4800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f13a8034df0 con 0x7f13a80ca680 2024-04-01T15:22:07.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.486+0000 7f9520c00640 1 -- 172.21.15.142:0/439169635 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f951c003cc0 con 0x7f952414f870 2024-04-01T15:22:07.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f9520c00640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f950406caf0 0x7f950406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f9520c00640 1 -- 172.21.15.142:0/439169635 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f951c08b800 con 0x7f952414f870 2024-04-01T15:22:07.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.488+0000 7f9528c00640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f950406caf0 0x7f950406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f13b1400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80d8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7fb686a00640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb66806c920 0x7fb66806ede0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb678006d40 tx=0x7fb678008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f13b1400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80d8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50526/0 (socket says 172.21.15.142:50526) 2024-04-01T15:22:07.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f13b1400640 1 -- 172.21.15.142:0/943753669 learned_addr learned my addr 172.21.15.142:0/943753669 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f13b1e00640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8036b50 0x7f13a80d80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f13b2800640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a80d1170 0x7f13a80d9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f2bb5200640 1 Processor -- start 2024-04-01T15:22:07.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f13b1400640 1 -- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8036b50 msgr2=0x7f13a80d80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f13b1400640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8036b50 0x7f13a80d80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f13b1400640 1 -- 172.21.15.142:0/943753669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a80d1170 msgr2=0x7f13a80d9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f13b1400640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a80d1170 0x7f13a80d9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.490+0000 7f13b1400640 1 -- 172.21.15.142:0/943753669 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a80da740 con 0x7f13a80ca680 2024-04-01T15:22:07.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.489+0000 7f2bb5200640 1 -- start start 2024-04-01T15:22:07.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.490+0000 7f9528c00640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f950406caf0 0x7f950406efb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9510007fd0 tx=0x7f9510007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.490+0000 7f13b1400640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80d8d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f139c00e870 tx=0x7f139c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.490+0000 7f4c45400640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c2c0043d0 0x7f4c2c0048a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c400ba640 tx=0x7f4c2c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95627b40138bc546 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.490+0000 7f13a6000640 1 -- 172.21.15.142:0/943753669 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c017070 con 0x7f13a80ca680 2024-04-01T15:22:07.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.491+0000 7f13a6000640 1 -- 172.21.15.142:0/943753669 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139c00c940 con 0x7f13a80ca680 2024-04-01T15:22:07.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.491+0000 7f13a6000640 1 -- 172.21.15.142:0/943753669 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c00cd30 con 0x7f13a80ca680 2024-04-01T15:22:07.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.491+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a80d6c80 con 0x7f13a80ca680 2024-04-01T15:22:07.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.491+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a80d7bc0 con 0x7f13a80ca680 2024-04-01T15:22:07.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.491+0000 7f2bb5200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb006d8d0 0x7f2bb00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.491+0000 7f2bb5200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2bb00b1410 0x7f2bb014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.492+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a80d7dc0 con 0x7f13a80ca680 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.492+0000 7f2bb5200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb006dcb0 con 0x7f2bb00b0fb0 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.492+0000 7f2bb5200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb00b0b20 con 0x7f2bb00b1410 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.492+0000 7f2bb5200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb0148ad0 con 0x7f2bb006d8d0 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.492+0000 7f2bade00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb006d8d0 0x7f2bb00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.492+0000 7f2bade00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb006d8d0 0x7f2bb00b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50530/0 (socket says 172.21.15.142:50530) 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.492+0000 7f2bade00640 1 -- 172.21.15.142:0/3738948075 learned_addr learned my addr 172.21.15.142:0/3738948075 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.493+0000 7f2bae800640 1 --2- 172.21.15.142:0/3738948075 >> v2:172.21.15.179:3300/0 conn(0x7f2bb00b1410 0x7f2bb014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.493+0000 7f2bade00640 1 -- 172.21.15.142:0/3738948075 >> v2:172.21.15.179:3300/0 conn(0x7f2bb00b1410 msgr2=0x7f2bb014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.493+0000 7f2bade00640 1 --2- 172.21.15.142:0/3738948075 >> v2:172.21.15.179:3300/0 conn(0x7f2bb00b1410 0x7f2bb014fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.493+0000 7f2bade00640 1 -- 172.21.15.142:0/3738948075 >> v1:172.21.15.179:6789/0 conn(0x7f2bb00b0fb0 legacy=0x7f2bb01491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.493+0000 7f2bade00640 1 -- 172.21.15.142:0/3738948075 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb00b5230 con 0x7f2bb006d8d0 2024-04-01T15:22:07.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.494+0000 7f13a6000640 1 -- 172.21.15.142:0/943753669 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f139c01a070 con 0x7f13a80ca680 2024-04-01T15:22:07.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.494+0000 7f2bade00640 1 --2- 172.21.15.142:0/3738948075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb006d8d0 0x7f2bb00b2d20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009e80 tx=0x7f2ba802bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6257c6e7585df2e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.495+0000 7f13a6000640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f139006c9c0 0x7f139006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.495+0000 7f13a6000640 1 -- 172.21.15.142:0/943753669 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f139c08bcd0 con 0x7f13a80ca680 2024-04-01T15:22:07.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.495+0000 7f13b1e00640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f139006c9c0 0x7f139006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.496+0000 7f13b1e00640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f139006c9c0 0x7f139006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f13a800afa0 tx=0x7f13ac0ab000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.497+0000 7f9520c00640 1 -- 172.21.15.142:0/439169635 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f951c059c60 con 0x7f952414f870 2024-04-01T15:22:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.503+0000 7f9ff6a00640 1 -- 172.21.15.142:0/2378892332 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40317c0 con 0x7f9ff806c4c0 2024-04-01T15:22:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.503+0000 7f9ff6a00640 1 -- 172.21.15.142:0/2378892332 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe4037070 con 0x7f9ff806c4c0 2024-04-01T15:22:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.503+0000 7f9ff6a00640 1 -- 172.21.15.142:0/2378892332 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4031b80 con 0x7f9ff806c4c0 2024-04-01T15:22:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.503+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38009d60 con 0x7f4c2c0043d0 2024-04-01T15:22:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.503+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3802ccc0 con 0x7f4c2c0043d0 2024-04-01T15:22:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f9ffda00640 1 -- 172.21.15.142:0/2378892332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff806c4c0 msgr2=0x7f9ff81443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7fb67f400640 1 -- 172.21.15.142:0/2591098842 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb6800597e0 con 0x7fb6880ae020 2024-04-01T15:22:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f9ffda00640 1 --2- 172.21.15.142:0/2378892332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff806c4c0 0x7f9ff81443c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009870 tx=0x7f9fe402b860 comp rx=0 tx=0).stop 2024-04-01T15:22:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f4c44a00640 1 -- 172.21.15.142:0/680218854 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38003bb0 con 0x7f4c2c0043d0 2024-04-01T15:22:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f4c47200640 1 -- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c2c0043d0 msgr2=0x7f4c2c0048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f4c47200640 1 --2- 172.21.15.142:0/680218854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c2c0043d0 0x7f4c2c0048a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c400ba640 tx=0x7f4c2c005830 comp rx=0 tx=0).stop 2024-04-01T15:22:07.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f9ffda00640 1 -- 172.21.15.142:0/2378892332 shutdown_connections 2024-04-01T15:22:07.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f9ffda00640 1 --2- 172.21.15.142:0/2378892332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff806c4c0 0x7f9ff81443c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f9ffda00640 1 --2- 172.21.15.142:0/2378892332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80af970 0x7f9ff8143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f9ffda00640 1 -- 172.21.15.142:0/2378892332 >> 172.21.15.142:0/2378892332 conn(0x7f9ff80b5790 msgr2=0x7f9ff80b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f9ffda00640 1 -- 172.21.15.142:0/2378892332 shutdown_connections 2024-04-01T15:22:07.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f9ffda00640 1 -- 172.21.15.142:0/2378892332 wait complete. 2024-04-01T15:22:07.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.504+0000 7f4c46800640 1 -- 172.21.15.142:0/680218854 reap_dead start 2024-04-01T15:22:07.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.505+0000 7f4c47200640 1 -- 172.21.15.142:0/680218854 shutdown_connections 2024-04-01T15:22:07.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.505+0000 7f4c47200640 1 -- 172.21.15.142:0/680218854 >> 172.21.15.142:0/680218854 conn(0x7f4c4002c3d0 msgr2=0x7f4c4002c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.505+0000 7f4c47200640 1 -- 172.21.15.142:0/680218854 shutdown_connections 2024-04-01T15:22:07.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.505+0000 7f4c47200640 1 -- 172.21.15.142:0/680218854 wait complete. 2024-04-01T15:22:07.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.507+0000 7f9ffda00640 1 Processor -- start 2024-04-01T15:22:07.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.507+0000 7f9ffda00640 1 -- start start 2024-04-01T15:22:07.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.508+0000 7f4c47200640 1 Processor -- start 2024-04-01T15:22:07.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.508+0000 7f9ffda00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff806c4c0 0x7f9ff81dcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.508+0000 7f9ffda00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff80af970 0x7f9ff8142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.508+0000 7f9ffda00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80b4cc0 0x7f9ff8070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.508+0000 7f9ffda00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff80aeba0 con 0x7f9ff806c4c0 2024-04-01T15:22:07.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.508+0000 7f9ffda00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff80ade70 con 0x7f9ff80af970 2024-04-01T15:22:07.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.508+0000 7f9ffda00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff806e020 con 0x7f9ff80b4cc0 2024-04-01T15:22:07.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.508+0000 7f4c47200640 1 -- start start 2024-04-01T15:22:07.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.509+0000 7f13a6000640 1 -- 172.21.15.142:0/943753669 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f13a80d7dc0 con 0x7f13a80ca680 2024-04-01T15:22:07.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.509+0000 7f4c47200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014a700 0x7f4c400bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.509+0000 7f4c47200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c401392f0 0x7f4c40139770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.509+0000 7f4c47200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c400bac40 0x7f4c400bb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.509+0000 7f4c47200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400b5630 con 0x7f4c400bac40 2024-04-01T15:22:07.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.509+0000 7f4c47200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400b5350 con 0x7f4c401392f0 2024-04-01T15:22:07.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.509+0000 7f4c47200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4c400b5910 con 0x7f4c4014a700 2024-04-01T15:22:07.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.509+0000 7f9ff7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff806c4c0 0x7f9ff81dcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f9ff7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff806c4c0 0x7f9ff81dcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51376/0 (socket says 172.21.15.142:51376) 2024-04-01T15:22:07.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f9ff7e00640 1 -- 172.21.15.142:0/1549061544 learned_addr learned my addr 172.21.15.142:0/1549061544 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f4c45e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014a700 0x7f4c400bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f4c45e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014a700 0x7f4c400bd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50554/0 (socket says 172.21.15.142:50554) 2024-04-01T15:22:07.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f4c45e00640 1 -- 172.21.15.142:0/3830580504 learned_addr learned my addr 172.21.15.142:0/3830580504 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f4c46800640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c400bac40 0x7f4c400bb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f9ff7e00640 1 -- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80b4cc0 msgr2=0x7f9ff8070730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T15:22:07.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f9ff7e00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80b4cc0 0x7f9ff8070730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f9ff7e00640 1 -- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff80af970 msgr2=0x7f9ff8142ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T15:22:07.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f9ff7e00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff80af970 0x7f9ff8142ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.510+0000 7f9ff7e00640 1 -- 172.21.15.142:0/1549061544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff806f730 con 0x7f9ff806c4c0 2024-04-01T15:22:07.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f4c45e00640 1 -- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c401392f0 msgr2=0x7f4c40139770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T15:22:07.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f4c45e00640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c401392f0 0x7f4c40139770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f4c45e00640 1 -- 172.21.15.142:0/3830580504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c400bac40 msgr2=0x7f4c400bb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f4c45e00640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c400bac40 0x7f4c400bb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f4c45e00640 1 -- 172.21.15.142:0/3830580504 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c40139cb0 con 0x7f4c4014a700 2024-04-01T15:22:07.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f9ff7e00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff806c4c0 0x7f9ff81dcef0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c760 tx=0x7f9ff000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f9fefe00640 1 -- 172.21.15.142:0/1549061544 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0016020 con 0x7f9ff806c4c0 2024-04-01T15:22:07.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f9fefe00640 1 -- 172.21.15.142:0/1549061544 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff0006d50 con 0x7f9ff806c4c0 2024-04-01T15:22:07.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f9fefe00640 1 -- 172.21.15.142:0/1549061544 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0003bb0 con 0x7f9ff806c4c0 2024-04-01T15:22:07.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.511+0000 7f2baca00640 1 -- 172.21.15.142:0/3738948075 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba802ca60 con 0x7f2bb006d8d0 2024-04-01T15:22:07.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.512+0000 7f2baca00640 1 -- 172.21.15.142:0/3738948075 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba802cc00 con 0x7f2bb006d8d0 2024-04-01T15:22:07.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.513+0000 7f2bb5200640 1 -- 172.21.15.142:0/3738948075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb006d8d0 msgr2=0x7f2bb00b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.513+0000 7f2bb5200640 1 --2- 172.21.15.142:0/3738948075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb006d8d0 0x7f2bb00b2d20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009e80 tx=0x7f2ba802bec0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.513+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff806ff60 con 0x7f9ff806c4c0 2024-04-01T15:22:07.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.513+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff8071c90 con 0x7f9ff806c4c0 2024-04-01T15:22:07.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.514+0000 7f4c45e00640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014a700 0x7f4c400bd0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c3f0 tx=0x7f4c3000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.514+0000 7f2bb5200640 1 -- 172.21.15.142:0/3738948075 shutdown_connections 2024-04-01T15:22:07.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.514+0000 7f2bb5200640 1 --2- 172.21.15.142:0/3738948075 >> v2:172.21.15.179:3300/0 conn(0x7f2bb00b1410 0x7f2bb014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.514+0000 7f2bb5200640 1 --2- 172.21.15.142:0/3738948075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb006d8d0 0x7f2bb00b2d20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.514+0000 7f2bb5200640 1 -- 172.21.15.142:0/3738948075 >> 172.21.15.142:0/3738948075 conn(0x7f2bb00b5890 msgr2=0x7f2bb00b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.514+0000 7f4c36000640 1 -- 172.21.15.142:0/3830580504 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30017070 con 0x7f4c4014a700 2024-04-01T15:22:07.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.514+0000 7f4c36000640 1 -- 172.21.15.142:0/3830580504 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c300035f0 con 0x7f4c4014a700 2024-04-01T15:22:07.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.515+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c40142cf0 con 0x7f4c4014a700 2024-04-01T15:22:07.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.515+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c40143a70 con 0x7f4c4014a700 2024-04-01T15:22:07.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.515+0000 7f4c36000640 1 -- 172.21.15.142:0/3830580504 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c300039e0 con 0x7f4c4014a700 2024-04-01T15:22:07.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.515+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff8068590 con 0x7f9ff806c4c0 2024-04-01T15:22:07.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.516+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c20005290 con 0x7f4c4014a700 2024-04-01T15:22:07.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.517+0000 7f2bb5200640 1 -- 172.21.15.142:0/3738948075 shutdown_connections 2024-04-01T15:22:07.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.517+0000 7f9fefe00640 1 -- 172.21.15.142:0/1549061544 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ff000a850 con 0x7f9ff806c4c0 2024-04-01T15:22:07.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.517+0000 7f2bb5200640 1 -- 172.21.15.142:0/3738948075 wait complete. 2024-04-01T15:22:07.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.519+0000 7f2bb5200640 1 Processor -- start 2024-04-01T15:22:07.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.520+0000 7f2bb5200640 1 -- start start 2024-04-01T15:22:07.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.519+0000 7f4c36000640 1 -- 172.21.15.142:0/3830580504 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c3001a070 con 0x7f4c4014a700 2024-04-01T15:22:07.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.521+0000 7f4c36000640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4c2406c9f0 0x7f4c2406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.521+0000 7f2bb5200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb006d8d0 0x7f2bb013d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.521+0000 7f4c36000640 1 -- 172.21.15.142:0/3830580504 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4c3008aec0 con 0x7f4c4014a700 2024-04-01T15:22:07.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.521+0000 7f2bb5200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb00b0fb0 0x7f2bb01dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.521+0000 7f2bb5200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb00b1410 0x7f2bb01473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.521+0000 7f2bb5200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb01498f0 con 0x7f2bb00b1410 2024-04-01T15:22:07.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.521+0000 7f2bb5200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb00b4e50 con 0x7f2bb006d8d0 2024-04-01T15:22:07.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.521+0000 7f2bb5200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb01488a0 con 0x7f2bb00b0fb0 2024-04-01T15:22:07.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f4c45400640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4c2406c9f0 0x7f4c2406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bad400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb00b0fb0 0x7f2bb01dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bae800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb00b1410 0x7f2bb01473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bad400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb00b0fb0 0x7f2bb01dd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:50562/0 (socket says 172.21.15.142:50562) 2024-04-01T15:22:07.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bad400640 1 -- 172.21.15.142:0/3585720659 learned_addr learned my addr 172.21.15.142:0/3585720659 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:07.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bade00640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb006d8d0 0x7f2bb013d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bae800640 1 -- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb00b0fb0 msgr2=0x7f2bb01dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bae800640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb00b0fb0 0x7f2bb01dd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bae800640 1 -- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb006d8d0 msgr2=0x7f2bb013d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bae800640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb006d8d0 0x7f2bb013d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f2bae800640 1 -- 172.21.15.142:0/3585720659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb01e0ca0 con 0x7f2bb00b1410 2024-04-01T15:22:07.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.523+0000 7f4c45400640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4c2406c9f0 0x7f4c2406eeb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c38035000 tx=0x7f4c3802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.523+0000 7f2bae800640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb00b1410 0x7f2bb01473c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000d490 tx=0x7f2ba000d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.522+0000 7f9fefe00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9fd806c940 0x7f9fd806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.523+0000 7f9ff7400640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9fd806c940 0x7f9fd806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.524+0000 7f9fefe00640 1 -- 172.21.15.142:0/1549061544 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9ff008b7b0 con 0x7f9ff806c4c0 2024-04-01T15:22:07.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.527+0000 7f9ff7400640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9fd806c940 0x7f9fd806ee00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80b2820 tx=0x7f9fe8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.529+0000 7f4c36000640 1 -- 172.21.15.142:0/3830580504 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4c30059360 con 0x7f4c4014a700 2024-04-01T15:22:07.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.529+0000 7f2ba6000640 1 -- 172.21.15.142:0/3585720659 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0004020 con 0x7f2bb00b1410 2024-04-01T15:22:07.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.529+0000 7f2ba6000640 1 -- 172.21.15.142:0/3585720659 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba00041c0 con 0x7f2bb00b1410 2024-04-01T15:22:07.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.529+0000 7f2ba6000640 1 -- 172.21.15.142:0/3585720659 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00043b0 con 0x7f2bb00b1410 2024-04-01T15:22:07.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.529+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb01e0f80 con 0x7f2bb00b1410 2024-04-01T15:22:07.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.529+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb01e1780 con 0x7f2bb00b1410 2024-04-01T15:22:07.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.531+0000 7f9fefe00640 1 -- 172.21.15.142:0/1549061544 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9ff0020020 con 0x7f9ff806c4c0 2024-04-01T15:22:07.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.532+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb0068710 con 0x7f2bb00b1410 2024-04-01T15:22:07.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.534+0000 7f2ba6000640 1 -- 172.21.15.142:0/3585720659 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ba001b020 con 0x7f2bb00b1410 2024-04-01T15:22:07.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.535+0000 7f2ba6000640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2b8c06caf0 0x7f2b8c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:07.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.535+0000 7f2ba6000640 1 -- 172.21.15.142:0/3585720659 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2ba000f040 con 0x7f2bb00b1410 2024-04-01T15:22:07.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.536+0000 7f2bade00640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2b8c06caf0 0x7f2b8c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:07.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.537+0000 7f2bade00640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2b8c06caf0 0x7f2b8c06efb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8035000 tx=0x7f2ba8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:07.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.544+0000 7f2ba6000640 1 -- 172.21.15.142:0/3585720659 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2ba00592c0 con 0x7f2bb00b1410 2024-04-01T15:22:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.840+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2a8809ad70 con 0x7f2a881443b0 2024-04-01T15:22:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.841+0000 7f2a7fe00640 1 -- 172.21.15.142:0/1787813283 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2a74058ec0 con 0x7f2a881443b0 2024-04-01T15:22:07.843 INFO:teuthology.orchestra.run.smithi142.stdout:55834574855 2024-04-01T15:22:07.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.844+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2a6806caf0 msgr2=0x7f2a6806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.845+0000 7f2a8d800640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2a6806caf0 0x7f2a6806efb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a78000f60 tx=0x7f2a780010a0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.845+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 msgr2=0x7f2a8806f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.845+0000 7f2a8d800640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 0x7f2a8806f6c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400e9c0 tx=0x7f2a7400ee80 comp rx=0 tx=0).stop 2024-04-01T15:22:07.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.846+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 shutdown_connections 2024-04-01T15:22:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.846+0000 7f2a8d800640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2a6806caf0 0x7f2a6806efb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.846+0000 7f2a8d800640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a881443b0 0x7f2a8806f6c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.846+0000 7f2a8d800640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a880b9200 0x7f2a880715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.846+0000 7f2a8d800640 1 --2- 172.21.15.142:0/1787813283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a880b4ec0 0x7f2a88147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.846+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 >> 172.21.15.142:0/1787813283 conn(0x7f2a8806c480 msgr2=0x7f2a881431c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.846+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 shutdown_connections 2024-04-01T15:22:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.846+0000 7f2a8d800640 1 -- 172.21.15.142:0/1787813283 wait complete. 2024-04-01T15:22:07.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.849+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efebc005850 con 0x7efee4145cd0 2024-04-01T15:22:07.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.850+0000 7efee0c00640 1 -- 172.21.15.142:0/940293258 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efed405d910 con 0x7efee4145cd0 2024-04-01T15:22:07.855 INFO:teuthology.orchestra.run.smithi142.stdout:55834574856 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.854+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7efec406caf0 msgr2=0x7efec406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.854+0000 7efeea600640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7efec406caf0 0x7efec406efb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efed0009bb0 tx=0x7efed0009240 comp rx=0 tx=0).stop 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.854+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efee4145cd0 msgr2=0x7efee40b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.854+0000 7efeea600640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efee4145cd0 0x7efee40b0c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efed400e870 tx=0x7efed400ed30 comp rx=0 tx=0).stop 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.855+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 shutdown_connections 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.855+0000 7efeea600640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7efec406caf0 0x7efec406efb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.855+0000 7efeea600640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee4146130 0x7efee4071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.855+0000 7efeea600640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efee4145cd0 0x7efee40b0c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.855+0000 7efeea600640 1 --2- 172.21.15.142:0/940293258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efee40b9e50 0x7efee40b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.855+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 >> 172.21.15.142:0/940293258 conn(0x7efee402c3d0 msgr2=0x7efee4144f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.856+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 shutdown_connections 2024-04-01T15:22:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.856+0000 7efeea600640 1 -- 172.21.15.142:0/940293258 wait complete. 2024-04-01T15:22:07.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-01T15:22:07.875 DEBUG:teuthology.parallel:result is None 2024-04-01T15:22:07.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-04-01T15:22:07.884 DEBUG:teuthology.parallel:result is None 2024-04-01T15:22:07.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.904+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb660005850 con 0x7fb6880ae020 2024-04-01T15:22:07.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.904+0000 7fb67f400640 1 -- 172.21.15.142:0/2591098842 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb68005dae0 con 0x7fb6880ae020 2024-04-01T15:22:07.906 INFO:teuthology.orchestra.run.smithi142.stdout:55834574856 2024-04-01T15:22:07.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb66806c920 msgr2=0x7fb66806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb66806c920 0x7fb66806ede0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb678006d40 tx=0x7fb678008040 comp rx=0 tx=0).stop 2024-04-01T15:22:07.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6880ae020 msgr2=0x7fb6881432a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6880ae020 0x7fb6881432a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb68000bd70 tx=0x7fb68000be60 comp rx=0 tx=0).stop 2024-04-01T15:22:07.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 shutdown_connections 2024-04-01T15:22:07.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb66806c920 0x7fb66806ede0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb688144530 0x7fb6881423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6880af720 0x7fb688072370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 --2- 172.21.15.142:0/2591098842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6880ae020 0x7fb6881432a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 >> 172.21.15.142:0/2591098842 conn(0x7fb6880b6c90 msgr2=0x7fb6880b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 shutdown_connections 2024-04-01T15:22:07.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.907+0000 7fb68e200640 1 -- 172.21.15.142:0/2591098842 wait complete. 2024-04-01T15:22:07.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.917+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4c20005850 con 0x7f4c4014a700 2024-04-01T15:22:07.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.918+0000 7f4c36000640 1 -- 172.21.15.142:0/3830580504 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c30058c60 con 0x7f4c4014a700 2024-04-01T15:22:07.919 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4c2406c9f0 msgr2=0x7f4c2406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4c2406c9f0 0x7f4c2406eeb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c38035000 tx=0x7f4c3802e000 comp rx=0 tx=0).stop 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014a700 msgr2=0x7f4c400bd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014a700 0x7f4c400bd0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c3f0 tx=0x7f4c3000c7f0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 shutdown_connections 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4c2406c9f0 0x7f4c2406eeb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c400bac40 0x7f4c400bb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c401392f0 0x7f4c40139770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 --2- 172.21.15.142:0/3830580504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c4014a700 0x7f4c400bd0a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 >> 172.21.15.142:0/3830580504 conn(0x7f4c4002c3d0 msgr2=0x7f4c401477d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 shutdown_connections 2024-04-01T15:22:07.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.920+0000 7f4c47200640 1 -- 172.21.15.142:0/3830580504 wait complete. 2024-04-01T15:22:07.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.929+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f94fc005580 con 0x7f952414f870 2024-04-01T15:22:07.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.930+0000 7f9520c00640 1 -- 172.21.15.142:0/439169635 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f951c059560 con 0x7f952414f870 2024-04-01T15:22:07.931 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2024-04-01T15:22:07.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-04-01T15:22:07.932 DEBUG:teuthology.parallel:result is None 2024-04-01T15:22:07.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.933+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f950406caf0 msgr2=0x7f950406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.933+0000 7f952b600640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f950406caf0 0x7f950406efb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9510007fd0 tx=0x7f9510007d40 comp rx=0 tx=0).stop 2024-04-01T15:22:07.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.933+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952414f870 msgr2=0x7f952414c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.933+0000 7f952b600640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952414f870 0x7f952414c2c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f951c00be00 tx=0x7f951c00bef0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.934+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 shutdown_connections 2024-04-01T15:22:07.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.934+0000 7f952b600640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f950406caf0 0x7f950406efb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.934+0000 7f952b600640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952414f870 0x7f952414c2c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.934+0000 7f952b600640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95240af200 0x7f95240721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.934+0000 7f952b600640 1 --2- 172.21.15.142:0/439169635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f952406d8d0 0x7f952414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.934+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 >> 172.21.15.142:0/439169635 conn(0x7f95240b5890 msgr2=0x7f952414e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.934+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 shutdown_connections 2024-04-01T15:22:07.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.934+0000 7f952b600640 1 -- 172.21.15.142:0/439169635 wait complete. 2024-04-01T15:22:07.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-04-01T15:22:07.940 DEBUG:teuthology.parallel:result is None 2024-04-01T15:22:07.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.943+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f13a80da460 con 0x7f13a80ca680 2024-04-01T15:22:07.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.944+0000 7f13a6000640 1 -- 172.21.15.142:0/943753669 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f139c059b20 con 0x7f13a80ca680 2024-04-01T15:22:07.945 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-04-01T15:22:07.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f139006c9c0 msgr2=0x7f139006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f139006c9c0 0x7f139006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f13a800afa0 tx=0x7f13ac0ab000 comp rx=0 tx=0).stop 2024-04-01T15:22:07.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 msgr2=0x7f13a80d8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80d8d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f139c00e870 tx=0x7f139c00ed30 comp rx=0 tx=0).stop 2024-04-01T15:22:07.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 shutdown_connections 2024-04-01T15:22:07.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f139006c9c0 0x7f139006ee80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a80d1170 0x7f13a80d9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a80ca680 0x7f13a80d8d10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 --2- 172.21.15.142:0/943753669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8036b50 0x7f13a80d80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.946+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 >> 172.21.15.142:0/943753669 conn(0x7f13a803abe0 msgr2=0x7f13a80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.947+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 shutdown_connections 2024-04-01T15:22:07.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.947+0000 7f13b4800640 1 -- 172.21.15.142:0/943753669 wait complete. 2024-04-01T15:22:07.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-04-01T15:22:07.953 DEBUG:teuthology.parallel:result is None 2024-04-01T15:22:07.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-04-01T15:22:07.964 DEBUG:teuthology.parallel:result is None 2024-04-01T15:22:07.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.967+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9ff81453f0 con 0x7f9ff806c4c0 2024-04-01T15:22:07.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.967+0000 7f9fefe00640 1 -- 172.21.15.142:0/1549061544 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ff0019310 con 0x7f9ff806c4c0 2024-04-01T15:22:07.968 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9fd806c940 msgr2=0x7f9fd806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9fd806c940 0x7f9fd806ee00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80b2820 tx=0x7f9fe8008040 comp rx=0 tx=0).stop 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff806c4c0 msgr2=0x7f9ff81dcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff806c4c0 0x7f9ff81dcef0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c760 tx=0x7f9ff000cc20 comp rx=0 tx=0).stop 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 shutdown_connections 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9fd806c940 0x7f9fd806ee00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80b4cc0 0x7f9ff8070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff80af970 0x7f9ff8142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 --2- 172.21.15.142:0/1549061544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff806c4c0 0x7f9ff81dcef0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.969+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 >> 172.21.15.142:0/1549061544 conn(0x7f9ff80b5790 msgr2=0x7f9ff80b8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.970+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 shutdown_connections 2024-04-01T15:22:07.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.970+0000 7f9ffda00640 1 -- 172.21.15.142:0/1549061544 wait complete. 2024-04-01T15:22:07.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.981+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2bb00b8930 con 0x7f2bb00b1410 2024-04-01T15:22:07.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.982+0000 7f2ba6000640 1 -- 172.21.15.142:0/3585720659 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ba0089e20 con 0x7f2bb00b1410 2024-04-01T15:22:07.983 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2b8c06caf0 msgr2=0x7f2b8c06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2b8c06caf0 0x7f2b8c06efb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8035000 tx=0x7f2ba8030000 comp rx=0 tx=0).stop 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb00b1410 msgr2=0x7f2bb01473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb00b1410 0x7f2bb01473c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000d490 tx=0x7f2ba000d950 comp rx=0 tx=0).stop 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 shutdown_connections 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f2b8c06caf0 0x7f2b8c06efb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb00b1410 0x7f2bb01473c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb00b0fb0 0x7f2bb01dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 --2- 172.21.15.142:0/3585720659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb006d8d0 0x7f2bb013d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 >> 172.21.15.142:0/3585720659 conn(0x7f2bb00b5890 msgr2=0x7f2bb01ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 shutdown_connections 2024-04-01T15:22:07.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:07.985+0000 7f2bb5200640 1 -- 172.21.15.142:0/3585720659 wait complete. 2024-04-01T15:22:07.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-04-01T15:22:07.992 DEBUG:teuthology.parallel:result is None 2024-04-01T15:22:08.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-04-01T15:22:08.003 DEBUG:teuthology.parallel:result is None 2024-04-01T15:22:08.003 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-01T15:22:08.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:22:08.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.246+0000 7f1a11a00640 1 Processor -- start 2024-04-01T15:22:08.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.247+0000 7f1a11a00640 1 -- start start 2024-04-01T15:22:08.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.248+0000 7f1a11a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 0x7f1a0c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.248+0000 7f1a11a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a0c0b22a0 0x7f1a0c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.248+0000 7f1a11a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a0c0b55a0 con 0x7f1a0c0afae0 2024-04-01T15:22:08.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.248+0000 7f1a11a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1a0c0b0430 con 0x7f1a0c0b22a0 2024-04-01T15:22:08.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.248+0000 7f1a11a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0c0ae8c0 con 0x7f1a0c0b51c0 2024-04-01T15:22:08.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.248+0000 7f1a0b400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a0c0b22a0 0x7f1a0c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.248+0000 7f1a0b400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a0c0b22a0 0x7f1a0c0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51398/0 (socket says 172.21.15.142:51398) 2024-04-01T15:22:08.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.248+0000 7f1a0b400640 1 -- 172.21.15.142:0/3921817718 learned_addr learned my addr 172.21.15.142:0/3921817718 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:08.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.249+0000 7f1a0aa00640 1 --2- 172.21.15.142:0/3921817718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 0x7f1a0c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.249+0000 7f1a0b400640 1 -- 172.21.15.142:0/3921817718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 msgr2=0x7f1a0c14ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:08.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.249+0000 7f1a0b400640 1 --2- 172.21.15.142:0/3921817718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 0x7f1a0c14ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.249+0000 7f1a0b400640 1 -- 172.21.15.142:0/3921817718 >> v1:172.21.15.179:6789/0 conn(0x7f1a0c0afae0 legacy=0x7f1a0c0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:08.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.249+0000 7f1a0b400640 1 -- 172.21.15.142:0/3921817718 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c06db20 con 0x7f1a0c0b22a0 2024-04-01T15:22:08.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.249+0000 7f1a0aa00640 1 --2- 172.21.15.142:0/3921817718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 0x7f1a0c14ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:08.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.250+0000 7f1a0b400640 1 --2- 172.21.15.142:0/3921817718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c0b22a0 0x7f1a0c0aede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009e50 tx=0x7f1a0402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b9d50c29be5aac server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:08.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.250+0000 7f1a0a000640 1 -- 172.21.15.142:0/3921817718 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0402c950 con 0x7f1a0c0b22a0 2024-04-01T15:22:08.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.250+0000 7f1a0a000640 1 -- 172.21.15.142:0/3921817718 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0402caf0 con 0x7f1a0c0b22a0 2024-04-01T15:22:08.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.250+0000 7f1a0a000640 1 -- 172.21.15.142:0/3921817718 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a040343f0 con 0x7f1a0c0b22a0 2024-04-01T15:22:08.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.250+0000 7f1a11a00640 1 -- 172.21.15.142:0/3921817718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c0b22a0 msgr2=0x7f1a0c0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.250+0000 7f1a11a00640 1 --2- 172.21.15.142:0/3921817718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c0b22a0 0x7f1a0c0aede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009e50 tx=0x7f1a0402bdb0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.251+0000 7f1a11a00640 1 -- 172.21.15.142:0/3921817718 shutdown_connections 2024-04-01T15:22:08.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.251+0000 7f1a11a00640 1 --2- 172.21.15.142:0/3921817718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c0b22a0 0x7f1a0c0aede0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.251+0000 7f1a11a00640 1 --2- 172.21.15.142:0/3921817718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 0x7f1a0c14ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.251+0000 7f1a11a00640 1 -- 172.21.15.142:0/3921817718 >> 172.21.15.142:0/3921817718 conn(0x7f1a0c0b5890 msgr2=0x7f1a0c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:08.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.251+0000 7f1a11a00640 1 -- 172.21.15.142:0/3921817718 shutdown_connections 2024-04-01T15:22:08.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.251+0000 7f1a11a00640 1 -- 172.21.15.142:0/3921817718 wait complete. 2024-04-01T15:22:08.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.252+0000 7f1a11a00640 1 Processor -- start 2024-04-01T15:22:08.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.252+0000 7f1a11a00640 1 -- start start 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a11a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c0b22a0 0x7f1a0c145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a11a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 0x7f1a0c147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a11a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c1478d0 0x7f1a0c1467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a11a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c0ae2f0 con 0x7f1a0c1478d0 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a11a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c0ae170 con 0x7f1a0c0b22a0 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a11a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0c1521c0 con 0x7f1a0c0b51c0 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a0b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c1478d0 0x7f1a0c1467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a0b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c1478d0 0x7f1a0c1467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51412/0 (socket says 172.21.15.142:51412) 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a0b400640 1 -- 172.21.15.142:0/2336293460 learned_addr learned my addr 172.21.15.142:0/2336293460 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a0b400640 1 -- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 msgr2=0x7f1a0c147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a0b400640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 0x7f1a0c147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a0b400640 1 -- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c0b22a0 msgr2=0x7f1a0c145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.253+0000 7f1a0aa00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c0b22a0 0x7f1a0c145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.254+0000 7f1a0b400640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c0b22a0 0x7f1a0c145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.254+0000 7f1a0b400640 1 -- 172.21.15.142:0/2336293460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c0707e0 con 0x7f1a0c1478d0 2024-04-01T15:22:08.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.254+0000 7f1a0b400640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c1478d0 0x7f1a0c1467a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a04036040 tx=0x7f1a04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:08.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.254+0000 7f1a02a00640 1 -- 172.21.15.142:0/2336293460 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04043020 con 0x7f1a0c1478d0 2024-04-01T15:22:08.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.254+0000 7f1a02a00640 1 -- 172.21.15.142:0/2336293460 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0403e450 con 0x7f1a0c1478d0 2024-04-01T15:22:08.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.254+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0c151d20 con 0x7f1a0c1478d0 2024-04-01T15:22:08.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.254+0000 7f1a02a00640 1 -- 172.21.15.142:0/2336293460 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0403e860 con 0x7f1a0c1478d0 2024-04-01T15:22:08.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.254+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0c148060 con 0x7f1a0c1478d0 2024-04-01T15:22:08.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.255+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0c068710 con 0x7f1a0c1478d0 2024-04-01T15:22:08.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.256+0000 7f1a02a00640 1 -- 172.21.15.142:0/2336293460 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a04046020 con 0x7f1a0c1478d0 2024-04-01T15:22:08.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.257+0000 7f1a02a00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f19e806c8f0 0x7f19e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.257+0000 7f1a02a00640 1 -- 172.21.15.142:0/2336293460 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1a040ae4e0 con 0x7f1a0c1478d0 2024-04-01T15:22:08.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.257+0000 7f1a0aa00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f19e806c8f0 0x7f19e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.258+0000 7f1a0aa00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f19e806c8f0 0x7f19e806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c1441e0 tx=0x7f19fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:08.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.262+0000 7f1a02a00640 1 -- 172.21.15.142:0/2336293460 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1a0404d030 con 0x7f1a0c1478d0 2024-04-01T15:22:08.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.446+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a0c14a5c0 con 0x7f19e806c8f0 2024-04-01T15:22:08.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.466+0000 7f1a02a00640 1 -- 172.21.15.142:0/2336293460 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f1a0c14a5c0 con 0x7f19e806c8f0 2024-04-01T15:22:08.471 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:08.472 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:22:08.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f19e806c8f0 msgr2=0x7f19e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f19e806c8f0 0x7f19e806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c1441e0 tx=0x7f19fc008040 comp rx=0 tx=0).stop 2024-04-01T15:22:08.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c1478d0 msgr2=0x7f1a0c1467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c1478d0 0x7f1a0c1467a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a04036040 tx=0x7f1a04004a40 comp rx=0 tx=0).stop 2024-04-01T15:22:08.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 shutdown_connections 2024-04-01T15:22:08.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f19e806c8f0 0x7f19e806edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0c1478d0 0x7f1a0c1467a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c0b51c0 0x7f1a0c147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 --2- 172.21.15.142:0/2336293460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c0b22a0 0x7f1a0c145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 >> 172.21.15.142:0/2336293460 conn(0x7f1a0c0b5890 msgr2=0x7f1a0c0b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:08.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 shutdown_connections 2024-04-01T15:22:08.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.472+0000 7f1a11a00640 1 -- 172.21.15.142:0/2336293460 wait complete. 2024-04-01T15:22:08.489 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-01T15:22:06.559569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.066747"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374534+0000","last_change":"2024-04-01T15:21:58.539004+0000","last_active":"2024-04-01T15:22:00.374534+0000","last_peered":"2024-04-01T15:22:00.374534+0000","last_clean":"2024-04-01T15:22:00.374534+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:22:00.374534+0000","last_undegraded":"2024-04-01T15:22:00.374534+0000","last_fullsized":"2024-04-01T15:22:00.374534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525492+0000","last_change":"2024-04-01T15:21:58.524238+0000","last_active":"2024-04-01T15:21:59.525492+0000","last_peered":"2024-04-01T15:21:59.525492+0000","last_clean":"2024-04-01T15:21:59.525492+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:21:59.525492+0000","last_undegraded":"2024-04-01T15:21:59.525492+0000","last_fullsized":"2024-04-01T15:21:59.525492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795772+0000","last_change":"2024-04-01T15:21:58.526226+0000","last_active":"2024-04-01T15:22:00.795772+0000","last_peered":"2024-04-01T15:22:00.795772+0000","last_clean":"2024-04-01T15:22:00.795772+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:22:00.795772+0000","last_undegraded":"2024-04-01T15:22:00.795772+0000","last_fullsized":"2024-04-01T15:22:00.795772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528754+0000","last_change":"2024-04-01T15:21:58.541297+0000","last_active":"2024-04-01T15:21:59.528754+0000","last_peered":"2024-04-01T15:21:59.528754+0000","last_clean":"2024-04-01T15:21:59.528754+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:21:59.528754+0000","last_undegraded":"2024-04-01T15:21:59.528754+0000","last_fullsized":"2024-04-01T15:21:59.528754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374212+0000","last_change":"2024-04-01T15:21:58.518814+0000","last_active":"2024-04-01T15:22:00.374212+0000","last_peered":"2024-04-01T15:22:00.374212+0000","last_clean":"2024-04-01T15:22:00.374212+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:22:00.374212+0000","last_undegraded":"2024-04-01T15:22:00.374212+0000","last_fullsized":"2024-04-01T15:22:00.374212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528497+0000","last_change":"2024-04-01T15:21:58.519850+0000","last_active":"2024-04-01T15:21:59.528497+0000","last_peered":"2024-04-01T15:21:59.528497+0000","last_clean":"2024-04-01T15:21:59.528497+0000","last_became_active":"2024-04-01T15:21:58.519517+0000","last_became_peered":"2024-04-01T15:21:58.519517+0000","last_unstale":"2024-04-01T15:21:59.528497+0000","last_undegraded":"2024-04-01T15:21:59.528497+0000","last_fullsized":"2024-04-01T15:21:59.528497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374983+0000","last_change":"2024-04-01T15:21:58.522961+0000","last_active":"2024-04-01T15:22:00.374983+0000","last_peered":"2024-04-01T15:22:00.374983+0000","last_clean":"2024-04-01T15:22:00.374983+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:22:00.374983+0000","last_undegraded":"2024-04-01T15:22:00.374983+0000","last_fullsized":"2024-04-01T15:22:00.374983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:51:33.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696563+0000","last_change":"2024-04-01T15:21:58.530231+0000","last_active":"2024-04-01T15:21:59.696563+0000","last_peered":"2024-04-01T15:21:59.696563+0000","last_clean":"2024-04-01T15:21:59.696563+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:21:59.696563+0000","last_undegraded":"2024-04-01T15:21:59.696563+0000","last_fullsized":"2024-04-01T15:21:59.696563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374727+0000","last_change":"2024-04-01T15:21:58.526959+0000","last_active":"2024-04-01T15:22:00.374727+0000","last_peered":"2024-04-01T15:22:00.374727+0000","last_clean":"2024-04-01T15:22:00.374727+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:22:00.374727+0000","last_undegraded":"2024-04-01T15:22:00.374727+0000","last_fullsized":"2024-04-01T15:22:00.374727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175156+0000","last_change":"2024-04-01T15:21:58.529489+0000","last_active":"2024-04-01T15:22:00.175156+0000","last_peered":"2024-04-01T15:22:00.175156+0000","last_clean":"2024-04-01T15:22:00.175156+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:22:00.175156+0000","last_undegraded":"2024-04-01T15:22:00.175156+0000","last_fullsized":"2024-04-01T15:22:00.175156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174888+0000","last_change":"2024-04-01T15:21:58.527803+0000","last_active":"2024-04-01T15:22:00.174888+0000","last_peered":"2024-04-01T15:22:00.174888+0000","last_clean":"2024-04-01T15:22:00.174888+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:22:00.174888+0000","last_undegraded":"2024-04-01T15:22:00.174888+0000","last_fullsized":"2024-04-01T15:22:00.174888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525348+0000","last_change":"2024-04-01T15:21:58.535848+0000","last_active":"2024-04-01T15:21:59.525348+0000","last_peered":"2024-04-01T15:21:59.525348+0000","last_clean":"2024-04-01T15:21:59.525348+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:21:59.525348+0000","last_undegraded":"2024-04-01T15:21:59.525348+0000","last_fullsized":"2024-04-01T15:21:59.525348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697039+0000","last_change":"2024-04-01T15:21:58.528912+0000","last_active":"2024-04-01T15:21:59.697039+0000","last_peered":"2024-04-01T15:21:59.697039+0000","last_clean":"2024-04-01T15:21:59.697039+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:21:59.697039+0000","last_undegraded":"2024-04-01T15:21:59.697039+0000","last_fullsized":"2024-04-01T15:21:59.697039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795333+0000","last_change":"2024-04-01T15:21:58.529847+0000","last_active":"2024-04-01T15:22:00.795333+0000","last_peered":"2024-04-01T15:22:00.795333+0000","last_clean":"2024-04-01T15:22:00.795333+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:22:00.795333+0000","last_undegraded":"2024-04-01T15:22:00.795333+0000","last_fullsized":"2024-04-01T15:22:00.795333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:44:07.006946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524893+0000","last_change":"2024-04-01T15:21:58.535414+0000","last_active":"2024-04-01T15:21:59.524893+0000","last_peered":"2024-04-01T15:21:59.524893+0000","last_clean":"2024-04-01T15:21:59.524893+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:21:59.524893+0000","last_undegraded":"2024-04-01T15:21:59.524893+0000","last_fullsized":"2024-04-01T15:21:59.524893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528323+0000","last_change":"2024-04-01T15:21:58.522234+0000","last_active":"2024-04-01T15:21:59.528323+0000","last_peered":"2024-04-01T15:21:59.528323+0000","last_clean":"2024-04-01T15:21:59.528323+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:21:59.528323+0000","last_undegraded":"2024-04-01T15:21:59.528323+0000","last_fullsized":"2024-04-01T15:21:59.528323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.530918+0000","last_change":"2024-04-01T15:21:58.531397+0000","last_active":"2024-04-01T15:21:59.530918+0000","last_peered":"2024-04-01T15:21:59.530918+0000","last_clean":"2024-04-01T15:21:59.530918+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:21:59.530918+0000","last_undegraded":"2024-04-01T15:21:59.530918+0000","last_fullsized":"2024-04-01T15:21:59.530918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.040302+0000","last_change":"2024-04-01T15:21:58.522828+0000","last_active":"2024-04-01T15:22:00.040302+0000","last_peered":"2024-04-01T15:22:00.040302+0000","last_clean":"2024-04-01T15:22:00.040302+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:22:00.040302+0000","last_undegraded":"2024-04-01T15:22:00.040302+0000","last_fullsized":"2024-04-01T15:22:00.040302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373931+0000","last_change":"2024-04-01T15:21:58.532575+0000","last_active":"2024-04-01T15:22:00.373931+0000","last_peered":"2024-04-01T15:22:00.373931+0000","last_clean":"2024-04-01T15:22:00.373931+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:22:00.373931+0000","last_undegraded":"2024-04-01T15:22:00.373931+0000","last_fullsized":"2024-04-01T15:22:00.373931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174864+0000","last_change":"2024-04-01T15:21:58.530543+0000","last_active":"2024-04-01T15:22:00.174864+0000","last_peered":"2024-04-01T15:22:00.174864+0000","last_clean":"2024-04-01T15:22:00.174864+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:22:00.174864+0000","last_undegraded":"2024-04-01T15:22:00.174864+0000","last_fullsized":"2024-04-01T15:22:00.174864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795532+0000","last_change":"2024-04-01T15:21:58.528377+0000","last_active":"2024-04-01T15:22:00.795532+0000","last_peered":"2024-04-01T15:22:00.795532+0000","last_clean":"2024-04-01T15:22:00.795532+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:22:00.795532+0000","last_undegraded":"2024-04-01T15:22:00.795532+0000","last_fullsized":"2024-04-01T15:22:00.795532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:56:09.008728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528834+0000","last_change":"2024-04-01T15:21:58.530746+0000","last_active":"2024-04-01T15:21:59.528834+0000","last_peered":"2024-04-01T15:21:59.528834+0000","last_clean":"2024-04-01T15:21:59.528834+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:21:59.528834+0000","last_undegraded":"2024-04-01T15:21:59.528834+0000","last_fullsized":"2024-04-01T15:21:59.528834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696730+0000","last_change":"2024-04-01T15:21:58.516408+0000","last_active":"2024-04-01T15:21:59.696730+0000","last_peered":"2024-04-01T15:21:59.696730+0000","last_clean":"2024-04-01T15:21:59.696730+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:21:59.696730+0000","last_undegraded":"2024-04-01T15:21:59.696730+0000","last_fullsized":"2024-04-01T15:21:59.696730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528199+0000","last_change":"2024-04-01T15:21:58.525868+0000","last_active":"2024-04-01T15:21:59.528199+0000","last_peered":"2024-04-01T15:21:59.528199+0000","last_clean":"2024-04-01T15:21:59.528199+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:21:59.528199+0000","last_undegraded":"2024-04-01T15:21:59.528199+0000","last_fullsized":"2024-04-01T15:21:59.528199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697382+0000","last_change":"2024-04-01T15:21:58.531952+0000","last_active":"2024-04-01T15:21:59.697382+0000","last_peered":"2024-04-01T15:21:59.697382+0000","last_clean":"2024-04-01T15:21:59.697382+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:21:59.697382+0000","last_undegraded":"2024-04-01T15:21:59.697382+0000","last_fullsized":"2024-04-01T15:21:59.697382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175425+0000","last_change":"2024-04-01T15:21:58.517341+0000","last_active":"2024-04-01T15:22:00.175425+0000","last_peered":"2024-04-01T15:22:00.175425+0000","last_clean":"2024-04-01T15:22:00.175425+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:22:00.175425+0000","last_undegraded":"2024-04-01T15:22:00.175425+0000","last_fullsized":"2024-04-01T15:22:00.175425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525136+0000","last_change":"2024-04-01T15:21:58.535087+0000","last_active":"2024-04-01T15:21:59.525136+0000","last_peered":"2024-04-01T15:21:59.525136+0000","last_clean":"2024-04-01T15:21:59.525136+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:21:59.525136+0000","last_undegraded":"2024-04-01T15:21:59.525136+0000","last_fullsized":"2024-04-01T15:21:59.525136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697491+0000","last_change":"2024-04-01T15:21:58.531487+0000","last_active":"2024-04-01T15:21:59.697491+0000","last_peered":"2024-04-01T15:21:59.697491+0000","last_clean":"2024-04-01T15:21:59.697491+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:21:59.697491+0000","last_undegraded":"2024-04-01T15:21:59.697491+0000","last_fullsized":"2024-04-01T15:21:59.697491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795574+0000","last_change":"2024-04-01T15:21:58.531305+0000","last_active":"2024-04-01T15:22:00.795574+0000","last_peered":"2024-04-01T15:22:00.795574+0000","last_clean":"2024-04-01T15:22:00.795574+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:22:00.795574+0000","last_undegraded":"2024-04-01T15:22:00.795574+0000","last_fullsized":"2024-04-01T15:22:00.795574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528885+0000","last_change":"2024-04-01T15:21:58.530998+0000","last_active":"2024-04-01T15:21:59.528885+0000","last_peered":"2024-04-01T15:21:59.528885+0000","last_clean":"2024-04-01T15:21:59.528885+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:21:59.528885+0000","last_undegraded":"2024-04-01T15:21:59.528885+0000","last_fullsized":"2024-04-01T15:21:59.528885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039960+0000","last_change":"2024-04-01T15:21:58.523119+0000","last_active":"2024-04-01T15:22:00.039960+0000","last_peered":"2024-04-01T15:22:00.039960+0000","last_clean":"2024-04-01T15:22:00.039960+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:22:00.039960+0000","last_undegraded":"2024-04-01T15:22:00.039960+0000","last_fullsized":"2024-04-01T15:22:00.039960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174268+0000","last_change":"2024-04-01T15:21:58.514302+0000","last_active":"2024-04-01T15:22:00.174268+0000","last_peered":"2024-04-01T15:22:00.174268+0000","last_clean":"2024-04-01T15:22:00.174268+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:22:00.174268+0000","last_undegraded":"2024-04-01T15:22:00.174268+0000","last_fullsized":"2024-04-01T15:22:00.174268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524902+0000","last_change":"2024-04-01T15:21:58.528525+0000","last_active":"2024-04-01T15:21:59.524902+0000","last_peered":"2024-04-01T15:21:59.524902+0000","last_clean":"2024-04-01T15:21:59.524902+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:21:59.524902+0000","last_undegraded":"2024-04-01T15:21:59.524902+0000","last_fullsized":"2024-04-01T15:21:59.524902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:58.054203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697111+0000","last_change":"2024-04-01T15:21:57.523557+0000","last_active":"2024-04-01T15:21:59.697111+0000","last_peered":"2024-04-01T15:21:59.697111+0000","last_clean":"2024-04-01T15:21:59.697111+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:21:59.697111+0000","last_undegraded":"2024-04-01T15:21:59.697111+0000","last_fullsized":"2024-04-01T15:21:59.697111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795700+0000","last_change":"2024-04-01T15:21:58.531570+0000","last_active":"2024-04-01T15:22:00.795700+0000","last_peered":"2024-04-01T15:22:00.795700+0000","last_clean":"2024-04-01T15:22:00.795700+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:22:00.795700+0000","last_undegraded":"2024-04-01T15:22:00.795700+0000","last_fullsized":"2024-04-01T15:22:00.795700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174511+0000","last_change":"2024-04-01T15:21:57.519248+0000","last_active":"2024-04-01T15:22:00.174511+0000","last_peered":"2024-04-01T15:22:00.174511+0000","last_clean":"2024-04-01T15:22:00.174511+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:22:00.174511+0000","last_undegraded":"2024-04-01T15:22:00.174511+0000","last_fullsized":"2024-04-01T15:22:00.174511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696520+0000","last_change":"2024-04-01T15:21:57.518727+0000","last_active":"2024-04-01T15:21:59.696520+0000","last_peered":"2024-04-01T15:21:59.696520+0000","last_clean":"2024-04-01T15:21:59.696520+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:21:59.696520+0000","last_undegraded":"2024-04-01T15:21:59.696520+0000","last_fullsized":"2024-04-01T15:21:59.696520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:15:36.993209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696524+0000","last_change":"2024-04-01T15:21:58.527894+0000","last_active":"2024-04-01T15:21:59.696524+0000","last_peered":"2024-04-01T15:21:59.696524+0000","last_clean":"2024-04-01T15:21:59.696524+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:21:59.696524+0000","last_undegraded":"2024-04-01T15:21:59.696524+0000","last_fullsized":"2024-04-01T15:21:59.696524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528268+0000","last_change":"2024-04-01T15:21:57.534982+0000","last_active":"2024-04-01T15:21:59.528268+0000","last_peered":"2024-04-01T15:21:59.528268+0000","last_clean":"2024-04-01T15:21:59.528268+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:21:59.528268+0000","last_undegraded":"2024-04-01T15:21:59.528268+0000","last_fullsized":"2024-04-01T15:21:59.528268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524398+0000","last_change":"2024-04-01T15:21:58.525017+0000","last_active":"2024-04-01T15:21:59.524398+0000","last_peered":"2024-04-01T15:21:59.524398+0000","last_clean":"2024-04-01T15:21:59.524398+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:21:59.524398+0000","last_undegraded":"2024-04-01T15:21:59.524398+0000","last_fullsized":"2024-04-01T15:21:59.524398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175037+0000","last_change":"2024-04-01T15:21:57.528840+0000","last_active":"2024-04-01T15:22:00.175037+0000","last_peered":"2024-04-01T15:22:00.175037+0000","last_clean":"2024-04-01T15:22:00.175037+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:22:00.175037+0000","last_undegraded":"2024-04-01T15:22:00.175037+0000","last_fullsized":"2024-04-01T15:22:00.175037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529666+0000","last_change":"2024-04-01T15:21:58.529422+0000","last_active":"2024-04-01T15:21:59.529666+0000","last_peered":"2024-04-01T15:21:59.529666+0000","last_clean":"2024-04-01T15:21:59.529666+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:21:59.529666+0000","last_undegraded":"2024-04-01T15:21:59.529666+0000","last_fullsized":"2024-04-01T15:21:59.529666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529803+0000","last_change":"2024-04-01T15:21:57.528345+0000","last_active":"2024-04-01T15:21:59.529803+0000","last_peered":"2024-04-01T15:21:59.529803+0000","last_clean":"2024-04-01T15:21:59.529803+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:21:59.529803+0000","last_undegraded":"2024-04-01T15:21:59.529803+0000","last_fullsized":"2024-04-01T15:21:59.529803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795783+0000","last_change":"2024-04-01T15:21:58.529376+0000","last_active":"2024-04-01T15:22:00.795783+0000","last_peered":"2024-04-01T15:22:00.795783+0000","last_clean":"2024-04-01T15:22:00.795783+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:22:00.795783+0000","last_undegraded":"2024-04-01T15:22:00.795783+0000","last_fullsized":"2024-04-01T15:22:00.795783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524861+0000","last_change":"2024-04-01T15:21:57.526610+0000","last_active":"2024-04-01T15:21:59.524861+0000","last_peered":"2024-04-01T15:21:59.524861+0000","last_clean":"2024-04-01T15:21:59.524861+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:21:59.524861+0000","last_undegraded":"2024-04-01T15:21:59.524861+0000","last_fullsized":"2024-04-01T15:21:59.524861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525355+0000","last_change":"2024-04-01T15:21:58.537476+0000","last_active":"2024-04-01T15:21:59.525355+0000","last_peered":"2024-04-01T15:21:59.525355+0000","last_clean":"2024-04-01T15:21:59.525355+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:21:59.525355+0000","last_undegraded":"2024-04-01T15:21:59.525355+0000","last_fullsized":"2024-04-01T15:21:59.525355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174501+0000","last_change":"2024-04-01T15:21:57.513766+0000","last_active":"2024-04-01T15:22:00.174501+0000","last_peered":"2024-04-01T15:22:00.174501+0000","last_clean":"2024-04-01T15:22:00.174501+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:22:00.174501+0000","last_undegraded":"2024-04-01T15:22:00.174501+0000","last_fullsized":"2024-04-01T15:22:00.174501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373572+0000","last_change":"2024-04-01T15:21:58.539751+0000","last_active":"2024-04-01T15:22:00.373572+0000","last_peered":"2024-04-01T15:22:00.373572+0000","last_clean":"2024-04-01T15:22:00.373572+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:22:00.373572+0000","last_undegraded":"2024-04-01T15:22:00.373572+0000","last_fullsized":"2024-04-01T15:22:00.373572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795635+0000","last_change":"2024-04-01T15:21:57.520158+0000","last_active":"2024-04-01T15:22:00.795635+0000","last_peered":"2024-04-01T15:22:00.795635+0000","last_clean":"2024-04-01T15:22:00.795635+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:22:00.795635+0000","last_undegraded":"2024-04-01T15:22:00.795635+0000","last_fullsized":"2024-04-01T15:22:00.795635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795381+0000","last_change":"2024-04-01T15:21:58.532249+0000","last_active":"2024-04-01T15:22:00.795381+0000","last_peered":"2024-04-01T15:22:00.795381+0000","last_clean":"2024-04-01T15:22:00.795381+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:22:00.795381+0000","last_undegraded":"2024-04-01T15:22:00.795381+0000","last_fullsized":"2024-04-01T15:22:00.795381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.229948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529411+0000","last_change":"2024-04-01T15:21:57.528780+0000","last_active":"2024-04-01T15:21:59.529411+0000","last_peered":"2024-04-01T15:21:59.529411+0000","last_clean":"2024-04-01T15:21:59.529411+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:21:59.529411+0000","last_undegraded":"2024-04-01T15:21:59.529411+0000","last_fullsized":"2024-04-01T15:21:59.529411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374292+0000","last_change":"2024-04-01T15:21:58.528458+0000","last_active":"2024-04-01T15:22:00.374292+0000","last_peered":"2024-04-01T15:22:00.374292+0000","last_clean":"2024-04-01T15:22:00.374292+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:22:00.374292+0000","last_undegraded":"2024-04-01T15:22:00.374292+0000","last_fullsized":"2024-04-01T15:22:00.374292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174063+0000","last_change":"2024-04-01T15:21:57.528026+0000","last_active":"2024-04-01T15:22:00.174063+0000","last_peered":"2024-04-01T15:22:00.174063+0000","last_clean":"2024-04-01T15:22:00.174063+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:22:00.174063+0000","last_undegraded":"2024-04-01T15:22:00.174063+0000","last_fullsized":"2024-04-01T15:22:00.174063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174372+0000","last_change":"2024-04-01T15:21:58.514047+0000","last_active":"2024-04-01T15:22:00.174372+0000","last_peered":"2024-04-01T15:22:00.174372+0000","last_clean":"2024-04-01T15:22:00.174372+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:22:00.174372+0000","last_undegraded":"2024-04-01T15:22:00.174372+0000","last_fullsized":"2024-04-01T15:22:00.174372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039609+0000","last_change":"2024-04-01T15:21:57.517184+0000","last_active":"2024-04-01T15:22:00.039609+0000","last_peered":"2024-04-01T15:22:00.039609+0000","last_clean":"2024-04-01T15:22:00.039609+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:22:00.039609+0000","last_undegraded":"2024-04-01T15:22:00.039609+0000","last_fullsized":"2024-04-01T15:22:00.039609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374874+0000","last_change":"2024-04-01T15:21:58.529946+0000","last_active":"2024-04-01T15:22:00.374874+0000","last_peered":"2024-04-01T15:22:00.374874+0000","last_clean":"2024-04-01T15:22:00.374874+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:22:00.374874+0000","last_undegraded":"2024-04-01T15:22:00.374874+0000","last_fullsized":"2024-04-01T15:22:00.374874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525712+0000","last_change":"2024-04-01T15:21:57.519642+0000","last_active":"2024-04-01T15:21:59.525712+0000","last_peered":"2024-04-01T15:21:59.525712+0000","last_clean":"2024-04-01T15:21:59.525712+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:21:59.525712+0000","last_undegraded":"2024-04-01T15:21:59.525712+0000","last_fullsized":"2024-04-01T15:21:59.525712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:09:07.894019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374100+0000","last_change":"2024-04-01T15:21:58.529121+0000","last_active":"2024-04-01T15:22:00.374100+0000","last_peered":"2024-04-01T15:22:00.374100+0000","last_clean":"2024-04-01T15:22:00.374100+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:22:00.374100+0000","last_undegraded":"2024-04-01T15:22:00.374100+0000","last_fullsized":"2024-04-01T15:22:00.374100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039988+0000","last_change":"2024-04-01T15:21:57.514455+0000","last_active":"2024-04-01T15:22:00.039988+0000","last_peered":"2024-04-01T15:22:00.039988+0000","last_clean":"2024-04-01T15:22:00.039988+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:22:00.039988+0000","last_undegraded":"2024-04-01T15:22:00.039988+0000","last_fullsized":"2024-04-01T15:22:00.039988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374717+0000","last_change":"2024-04-01T15:21:58.535610+0000","last_active":"2024-04-01T15:22:00.374717+0000","last_peered":"2024-04-01T15:22:00.374717+0000","last_clean":"2024-04-01T15:22:00.374717+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:22:00.374717+0000","last_undegraded":"2024-04-01T15:22:00.374717+0000","last_fullsized":"2024-04-01T15:22:00.374717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524990+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:21:59.524990+0000","last_peered":"2024-04-01T15:21:59.524990+0000","last_clean":"2024-04-01T15:21:59.524990+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:21:59.524990+0000","last_undegraded":"2024-04-01T15:21:59.524990+0000","last_fullsized":"2024-04-01T15:21:59.524990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529157+0000","last_change":"2024-04-01T15:21:58.533365+0000","last_active":"2024-04-01T15:21:59.529157+0000","last_peered":"2024-04-01T15:21:59.529157+0000","last_clean":"2024-04-01T15:21:59.529157+0000","last_became_active":"2024-04-01T15:21:58.533141+0000","last_became_peered":"2024-04-01T15:21:58.533141+0000","last_unstale":"2024-04-01T15:21:59.529157+0000","last_undegraded":"2024-04-01T15:21:59.529157+0000","last_fullsized":"2024-04-01T15:21:59.529157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039888+0000","last_change":"2024-04-01T15:21:57.532167+0000","last_active":"2024-04-01T15:22:00.039888+0000","last_peered":"2024-04-01T15:22:00.039888+0000","last_clean":"2024-04-01T15:22:00.039888+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:22:00.039888+0000","last_undegraded":"2024-04-01T15:22:00.039888+0000","last_fullsized":"2024-04-01T15:22:00.039888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373757+0000","last_change":"2024-04-01T15:21:58.530108+0000","last_active":"2024-04-01T15:22:00.373757+0000","last_peered":"2024-04-01T15:22:00.373757+0000","last_clean":"2024-04-01T15:22:00.373757+0000","last_became_active":"2024-04-01T15:21:58.529794+0000","last_became_peered":"2024-04-01T15:21:58.529794+0000","last_unstale":"2024-04-01T15:22:00.373757+0000","last_undegraded":"2024-04-01T15:22:00.373757+0000","last_fullsized":"2024-04-01T15:22:00.373757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373799+0000","last_change":"2024-04-01T15:21:47.878530+0000","last_active":"2024-04-01T15:22:00.373799+0000","last_peered":"2024-04-01T15:22:00.373799+0000","last_clean":"2024-04-01T15:22:00.373799+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:22:00.373799+0000","last_undegraded":"2024-04-01T15:22:00.373799+0000","last_fullsized":"2024-04-01T15:22:00.373799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_clean_scrub_stamp":"2024-04-01T15:21:46.852307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:25:18.137507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528321+0000","last_change":"2024-04-01T15:21:57.530394+0000","last_active":"2024-04-01T15:21:59.528321+0000","last_peered":"2024-04-01T15:21:59.528321+0000","last_clean":"2024-04-01T15:21:59.528321+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:21:59.528321+0000","last_undegraded":"2024-04-01T15:21:59.528321+0000","last_fullsized":"2024-04-01T15:21:59.528321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697106+0000","last_change":"2024-04-01T15:21:58.529751+0000","last_active":"2024-04-01T15:21:59.697106+0000","last_peered":"2024-04-01T15:21:59.697106+0000","last_clean":"2024-04-01T15:21:59.697106+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:21:59.697106+0000","last_undegraded":"2024-04-01T15:21:59.697106+0000","last_fullsized":"2024-04-01T15:21:59.697106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373518+0000","last_change":"2024-04-01T15:21:57.526919+0000","last_active":"2024-04-01T15:22:00.373518+0000","last_peered":"2024-04-01T15:22:00.373518+0000","last_clean":"2024-04-01T15:22:00.373518+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:22:00.373518+0000","last_undegraded":"2024-04-01T15:22:00.373518+0000","last_fullsized":"2024-04-01T15:22:00.373518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.796128+0000","last_change":"2024-04-01T15:21:58.525329+0000","last_active":"2024-04-01T15:22:00.796128+0000","last_peered":"2024-04-01T15:22:00.796128+0000","last_clean":"2024-04-01T15:22:00.796128+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:22:00.796128+0000","last_undegraded":"2024-04-01T15:22:00.796128+0000","last_fullsized":"2024-04-01T15:22:00.796128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.040177+0000","last_change":"2024-04-01T15:21:57.511176+0000","last_active":"2024-04-01T15:22:00.040177+0000","last_peered":"2024-04-01T15:22:00.040177+0000","last_clean":"2024-04-01T15:22:00.040177+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:22:00.040177+0000","last_undegraded":"2024-04-01T15:22:00.040177+0000","last_fullsized":"2024-04-01T15:22:00.040177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524559+0000","last_change":"2024-04-01T15:21:58.523794+0000","last_active":"2024-04-01T15:21:59.524559+0000","last_peered":"2024-04-01T15:21:59.524559+0000","last_clean":"2024-04-01T15:21:59.524559+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:21:59.524559+0000","last_undegraded":"2024-04-01T15:21:59.524559+0000","last_fullsized":"2024-04-01T15:21:59.524559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529840+0000","last_change":"2024-04-01T15:21:57.527763+0000","last_active":"2024-04-01T15:21:59.529840+0000","last_peered":"2024-04-01T15:21:59.529840+0000","last_clean":"2024-04-01T15:21:59.529840+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:21:59.529840+0000","last_undegraded":"2024-04-01T15:21:59.529840+0000","last_fullsized":"2024-04-01T15:21:59.529840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524921+0000","last_change":"2024-04-01T15:21:58.531026+0000","last_active":"2024-04-01T15:21:59.524921+0000","last_peered":"2024-04-01T15:21:59.524921+0000","last_clean":"2024-04-01T15:21:59.524921+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:21:59.524921+0000","last_undegraded":"2024-04-01T15:21:59.524921+0000","last_fullsized":"2024-04-01T15:21:59.524921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:50.706762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524830+0000","last_change":"2024-04-01T15:21:57.517159+0000","last_active":"2024-04-01T15:21:59.524830+0000","last_peered":"2024-04-01T15:21:59.524830+0000","last_clean":"2024-04-01T15:21:59.524830+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:21:59.524830+0000","last_undegraded":"2024-04-01T15:21:59.524830+0000","last_fullsized":"2024-04-01T15:21:59.524830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529965+0000","last_change":"2024-04-01T15:21:58.541348+0000","last_active":"2024-04-01T15:21:59.529965+0000","last_peered":"2024-04-01T15:21:59.529965+0000","last_clean":"2024-04-01T15:21:59.529965+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:21:59.529965+0000","last_undegraded":"2024-04-01T15:21:59.529965+0000","last_fullsized":"2024-04-01T15:21:59.529965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373995+0000","last_change":"2024-04-01T15:21:57.526914+0000","last_active":"2024-04-01T15:22:00.373995+0000","last_peered":"2024-04-01T15:22:00.373995+0000","last_clean":"2024-04-01T15:22:00.373995+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:22:00.373995+0000","last_undegraded":"2024-04-01T15:22:00.373995+0000","last_fullsized":"2024-04-01T15:22:00.373995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524661+0000","last_change":"2024-04-01T15:21:58.515834+0000","last_active":"2024-04-01T15:21:59.524661+0000","last_peered":"2024-04-01T15:21:59.524661+0000","last_clean":"2024-04-01T15:21:59.524661+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:21:59.524661+0000","last_undegraded":"2024-04-01T15:21:59.524661+0000","last_fullsized":"2024-04-01T15:21:59.524661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525272+0000","last_change":"2024-04-01T15:21:57.533452+0000","last_active":"2024-04-01T15:21:59.525272+0000","last_peered":"2024-04-01T15:21:59.525272+0000","last_clean":"2024-04-01T15:21:59.525272+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:21:59.525272+0000","last_undegraded":"2024-04-01T15:21:59.525272+0000","last_fullsized":"2024-04-01T15:21:59.525272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697608+0000","last_change":"2024-04-01T15:21:58.512191+0000","last_active":"2024-04-01T15:21:59.697608+0000","last_peered":"2024-04-01T15:21:59.697608+0000","last_clean":"2024-04-01T15:21:59.697608+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:21:59.697608+0000","last_undegraded":"2024-04-01T15:21:59.697608+0000","last_fullsized":"2024-04-01T15:21:59.697608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175206+0000","last_change":"2024-04-01T15:21:57.526196+0000","last_active":"2024-04-01T15:22:00.175206+0000","last_peered":"2024-04-01T15:22:00.175206+0000","last_clean":"2024-04-01T15:22:00.175206+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:22:00.175206+0000","last_undegraded":"2024-04-01T15:22:00.175206+0000","last_fullsized":"2024-04-01T15:22:00.175206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795819+0000","last_change":"2024-04-01T15:21:58.526739+0000","last_active":"2024-04-01T15:22:00.795819+0000","last_peered":"2024-04-01T15:22:00.795819+0000","last_clean":"2024-04-01T15:22:00.795819+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:22:00.795819+0000","last_undegraded":"2024-04-01T15:22:00.795819+0000","last_fullsized":"2024-04-01T15:22:00.795819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373249+0000","last_change":"2024-04-01T15:21:57.526924+0000","last_active":"2024-04-01T15:22:00.373249+0000","last_peered":"2024-04-01T15:22:00.373249+0000","last_clean":"2024-04-01T15:22:00.373249+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:22:00.373249+0000","last_undegraded":"2024-04-01T15:22:00.373249+0000","last_fullsized":"2024-04-01T15:22:00.373249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524505+0000","last_change":"2024-04-01T15:21:58.528396+0000","last_active":"2024-04-01T15:21:59.524505+0000","last_peered":"2024-04-01T15:21:59.524505+0000","last_clean":"2024-04-01T15:21:59.524505+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:21:59.524505+0000","last_undegraded":"2024-04-01T15:21:59.524505+0000","last_fullsized":"2024-04-01T15:21:59.524505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:50.943225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525048+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:21:59.525048+0000","last_peered":"2024-04-01T15:21:59.525048+0000","last_clean":"2024-04-01T15:21:59.525048+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:21:59.525048+0000","last_undegraded":"2024-04-01T15:21:59.525048+0000","last_fullsized":"2024-04-01T15:21:59.525048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:09.572891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696891+0000","last_change":"2024-04-01T15:21:58.529955+0000","last_active":"2024-04-01T15:21:59.696891+0000","last_peered":"2024-04-01T15:21:59.696891+0000","last_clean":"2024-04-01T15:21:59.696891+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:21:59.696891+0000","last_undegraded":"2024-04-01T15:21:59.696891+0000","last_fullsized":"2024-04-01T15:21:59.696891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524416+0000","last_change":"2024-04-01T15:21:57.526620+0000","last_active":"2024-04-01T15:21:59.524416+0000","last_peered":"2024-04-01T15:21:59.524416+0000","last_clean":"2024-04-01T15:21:59.524416+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:21:59.524416+0000","last_undegraded":"2024-04-01T15:21:59.524416+0000","last_fullsized":"2024-04-01T15:21:59.524416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697310+0000","last_change":"2024-04-01T15:21:58.534484+0000","last_active":"2024-04-01T15:21:59.697310+0000","last_peered":"2024-04-01T15:21:59.697310+0000","last_clean":"2024-04-01T15:21:59.697310+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:21:59.697310+0000","last_undegraded":"2024-04-01T15:21:59.697310+0000","last_fullsized":"2024-04-01T15:21:59.697310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374424+0000","last_change":"2024-04-01T15:21:57.531639+0000","last_active":"2024-04-01T15:22:00.374424+0000","last_peered":"2024-04-01T15:22:00.374424+0000","last_clean":"2024-04-01T15:22:00.374424+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:22:00.374424+0000","last_undegraded":"2024-04-01T15:22:00.374424+0000","last_fullsized":"2024-04-01T15:22:00.374424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174380+0000","last_change":"2024-04-01T15:21:58.523366+0000","last_active":"2024-04-01T15:22:00.174380+0000","last_peered":"2024-04-01T15:22:00.174380+0000","last_clean":"2024-04-01T15:22:00.174380+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:22:00.174380+0000","last_undegraded":"2024-04-01T15:22:00.174380+0000","last_fullsized":"2024-04-01T15:22:00.174380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529585+0000","last_change":"2024-04-01T15:21:58.526457+0000","last_active":"2024-04-01T15:21:59.529585+0000","last_peered":"2024-04-01T15:21:59.529585+0000","last_clean":"2024-04-01T15:21:59.529585+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:21:59.529585+0000","last_undegraded":"2024-04-01T15:21:59.529585+0000","last_fullsized":"2024-04-01T15:21:59.529585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373310+0000","last_change":"2024-04-01T15:21:57.534510+0000","last_active":"2024-04-01T15:22:00.373310+0000","last_peered":"2024-04-01T15:22:00.373310+0000","last_clean":"2024-04-01T15:22:00.373310+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:22:00.373310+0000","last_undegraded":"2024-04-01T15:22:00.373310+0000","last_fullsized":"2024-04-01T15:22:00.373310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528978+0000","last_change":"2024-04-01T15:21:58.537101+0000","last_active":"2024-04-01T15:21:59.528978+0000","last_peered":"2024-04-01T15:21:59.528978+0000","last_clean":"2024-04-01T15:21:59.528978+0000","last_became_active":"2024-04-01T15:21:58.536776+0000","last_became_peered":"2024-04-01T15:21:58.536776+0000","last_unstale":"2024-04-01T15:21:59.528978+0000","last_undegraded":"2024-04-01T15:21:59.528978+0000","last_fullsized":"2024-04-01T15:21:59.528978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373757+0000","last_change":"2024-04-01T15:21:57.533797+0000","last_active":"2024-04-01T15:22:00.373757+0000","last_peered":"2024-04-01T15:22:00.373757+0000","last_clean":"2024-04-01T15:22:00.373757+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:22:00.373757+0000","last_undegraded":"2024-04-01T15:22:00.373757+0000","last_fullsized":"2024-04-01T15:22:00.373757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:16:16.205030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795639+0000","last_change":"2024-04-01T15:21:58.524922+0000","last_active":"2024-04-01T15:22:00.795639+0000","last_peered":"2024-04-01T15:22:00.795639+0000","last_clean":"2024-04-01T15:22:00.795639+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:22:00.795639+0000","last_undegraded":"2024-04-01T15:22:00.795639+0000","last_fullsized":"2024-04-01T15:22:00.795639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697725+0000","last_change":"2024-04-01T15:21:57.518934+0000","last_active":"2024-04-01T15:21:59.697725+0000","last_peered":"2024-04-01T15:21:59.697725+0000","last_clean":"2024-04-01T15:21:59.697725+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:21:59.697725+0000","last_undegraded":"2024-04-01T15:21:59.697725+0000","last_fullsized":"2024-04-01T15:21:59.697725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697866+0000","last_change":"2024-04-01T15:21:58.538259+0000","last_active":"2024-04-01T15:21:59.697866+0000","last_peered":"2024-04-01T15:21:59.697866+0000","last_clean":"2024-04-01T15:21:59.697866+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:21:59.697866+0000","last_undegraded":"2024-04-01T15:21:59.697866+0000","last_fullsized":"2024-04-01T15:21:59.697866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795827+0000","last_change":"2024-04-01T15:21:57.524507+0000","last_active":"2024-04-01T15:22:00.795827+0000","last_peered":"2024-04-01T15:22:00.795827+0000","last_clean":"2024-04-01T15:22:00.795827+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:22:00.795827+0000","last_undegraded":"2024-04-01T15:22:00.795827+0000","last_fullsized":"2024-04-01T15:22:00.795827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:29:44.659776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:22:08.493 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:22:08.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.735+0000 7f35c6800640 1 Processor -- start 2024-04-01T15:22:08.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.735+0000 7f35c6800640 1 -- start start 2024-04-01T15:22:08.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.736+0000 7f35c6800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c006d8d0 0x7f35c00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.736+0000 7f35c6800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35c00b0fb0 0x7f35c01491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.736+0000 7f35c6800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35c0149720 0x7f35c00b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.736+0000 7f35c6800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f35c00b0b20 con 0x7f35c0149720 2024-04-01T15:22:08.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.736+0000 7f35c6800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f35c006dcb0 con 0x7f35c00b0fb0 2024-04-01T15:22:08.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.736+0000 7f35c6800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f35c0148ad0 con 0x7f35c006d8d0 2024-04-01T15:22:08.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.736+0000 7f35bfe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35c0149720 0x7f35c00b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.736+0000 7f35bfe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35c0149720 0x7f35c00b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51418/0 (socket says 172.21.15.142:51418) 2024-04-01T15:22:08.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.736+0000 7f35bfe00640 1 -- 172.21.15.142:0/1690952813 learned_addr learned my addr 172.21.15.142:0/1690952813 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:08.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.737+0000 7f35b6a00640 1 --2- 172.21.15.142:0/1690952813 >> v2:172.21.15.179:3300/0 conn(0x7f35c00b0fb0 0x7f35c01491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.737+0000 7f35bf400640 1 --2- 172.21.15.142:0/1690952813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c006d8d0 0x7f35c00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.737+0000 7f35bfe00640 1 -- 172.21.15.142:0/1690952813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c006d8d0 msgr2=0x7f35c00b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:08.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.737+0000 7f35bfe00640 1 --2- 172.21.15.142:0/1690952813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c006d8d0 0x7f35c00b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.737+0000 7f35bfe00640 1 -- 172.21.15.142:0/1690952813 >> v2:172.21.15.179:3300/0 conn(0x7f35c00b0fb0 msgr2=0x7f35c01491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:08.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.737+0000 7f35bfe00640 1 --2- 172.21.15.142:0/1690952813 >> v2:172.21.15.179:3300/0 conn(0x7f35c00b0fb0 0x7f35c01491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.737+0000 7f35bfe00640 1 -- 172.21.15.142:0/1690952813 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c00b5230 con 0x7f35c0149720 2024-04-01T15:22:08.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.738+0000 7f35bfe00640 1 --2- 172.21.15.142:0/1690952813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c0149720 0x7f35c00b3790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35c00b0120 tx=0x7f35b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0756b3117ced7f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:08.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.738+0000 7f35bea00640 1 -- 172.21.15.142:0/1690952813 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b802ca70 con 0x7f35c0149720 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.738+0000 7f35bea00640 1 -- 172.21.15.142:0/1690952813 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b802cc10 con 0x7f35c0149720 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.738+0000 7f35bea00640 1 -- 172.21.15.142:0/1690952813 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80343f0 con 0x7f35c0149720 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.739+0000 7f35c6800640 1 -- 172.21.15.142:0/1690952813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c0149720 msgr2=0x7f35c00b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.739+0000 7f35c6800640 1 --2- 172.21.15.142:0/1690952813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c0149720 0x7f35c00b3790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35c00b0120 tx=0x7f35b802bed0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.739+0000 7f35c6800640 1 -- 172.21.15.142:0/1690952813 shutdown_connections 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.739+0000 7f35c6800640 1 --2- 172.21.15.142:0/1690952813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c0149720 0x7f35c00b3790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.739+0000 7f35c6800640 1 --2- 172.21.15.142:0/1690952813 >> v2:172.21.15.179:3300/0 conn(0x7f35c00b0fb0 0x7f35c01491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.739+0000 7f35c6800640 1 --2- 172.21.15.142:0/1690952813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c006d8d0 0x7f35c00b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.739+0000 7f35c6800640 1 -- 172.21.15.142:0/1690952813 >> 172.21.15.142:0/1690952813 conn(0x7f35c00b5890 msgr2=0x7f35c00b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.739+0000 7f35c6800640 1 -- 172.21.15.142:0/1690952813 shutdown_connections 2024-04-01T15:22:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.739+0000 7f35c6800640 1 -- 172.21.15.142:0/1690952813 wait complete. 2024-04-01T15:22:08.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.741+0000 7f35c6800640 1 Processor -- start 2024-04-01T15:22:08.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.741+0000 7f35c6800640 1 -- start start 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.742+0000 7f35c6800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c006d8d0 0x7f35c0145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.742+0000 7f35c6800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c00b0fb0 0x7f35c01427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.742+0000 7f35c6800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c0149720 0x7f35c013a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.742+0000 7f35c6800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f35c00b4fd0 con 0x7f35c006d8d0 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.742+0000 7f35c6800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f35c00b4e50 con 0x7f35c00b0fb0 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.742+0000 7f35c6800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f35c009edc0 con 0x7f35c0149720 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.742+0000 7f35bf400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c006d8d0 0x7f35c0145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.742+0000 7f35bf400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c006d8d0 0x7f35c0145280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51428/0 (socket says 172.21.15.142:51428) 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.742+0000 7f35bf400640 1 -- 172.21.15.142:0/3804920604 learned_addr learned my addr 172.21.15.142:0/3804920604 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35b6a00640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c00b0fb0 0x7f35c01427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35bfe00640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c0149720 0x7f35c013a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35bf400640 1 -- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c0149720 msgr2=0x7f35c013a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35bf400640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c0149720 0x7f35c013a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35bf400640 1 -- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c00b0fb0 msgr2=0x7f35c01427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35bf400640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c00b0fb0 0x7f35c01427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35bf400640 1 -- 172.21.15.142:0/3804920604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c0141e60 con 0x7f35c006d8d0 2024-04-01T15:22:08.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35bf400640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c006d8d0 0x7f35c0145280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f35b000d800 tx=0x7f35b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:08.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35b7e00640 1 -- 172.21.15.142:0/3804920604 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b000b6c0 con 0x7f35c006d8d0 2024-04-01T15:22:08.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35b7e00640 1 -- 172.21.15.142:0/3804920604 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b0019070 con 0x7f35c006d8d0 2024-04-01T15:22:08.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35b7e00640 1 -- 172.21.15.142:0/3804920604 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b000ba80 con 0x7f35c006d8d0 2024-04-01T15:22:08.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.743+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c00af470 con 0x7f35c006d8d0 2024-04-01T15:22:08.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.744+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c0145f60 con 0x7f35c006d8d0 2024-04-01T15:22:08.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.745+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c0068710 con 0x7f35c006d8d0 2024-04-01T15:22:08.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.746+0000 7f35b7e00640 1 -- 172.21.15.142:0/3804920604 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35b000bc20 con 0x7f35c006d8d0 2024-04-01T15:22:08.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.746+0000 7f35b7e00640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f359c06c920 0x7f359c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.746+0000 7f35b7e00640 1 -- 172.21.15.142:0/3804920604 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f35b008bff0 con 0x7f35c006d8d0 2024-04-01T15:22:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.747+0000 7f35b6a00640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f359c06c920 0x7f359c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.748+0000 7f35b6a00640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f359c06c920 0x7f359c06ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35c0143400 tx=0x7f35a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:08.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.751+0000 7f35b7e00640 1 -- 172.21.15.142:0/3804920604 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f35b005a430 con 0x7f35c006d8d0 2024-04-01T15:22:08.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.930+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35c00b8b70 con 0x7f359c06c920 2024-04-01T15:22:08.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.949+0000 7f35b7e00640 1 -- 172.21.15.142:0/3804920604 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f35c00b8b70 con 0x7f359c06c920 2024-04-01T15:22:08.954 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:08.955 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.954+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f359c06c920 msgr2=0x7f359c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.954+0000 7f35c6800640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f359c06c920 0x7f359c06ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35c0143400 tx=0x7f35a8008040 comp rx=0 tx=0).stop 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.954+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c006d8d0 msgr2=0x7f35c0145280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.954+0000 7f35c6800640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c006d8d0 0x7f35c0145280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f35b000d800 tx=0x7f35b000dcc0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.954+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 shutdown_connections 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.955+0000 7f35c6800640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f359c06c920 0x7f359c06ede0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.955+0000 7f35c6800640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c0149720 0x7f35c013a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.955+0000 7f35c6800640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c00b0fb0 0x7f35c01427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.955+0000 7f35c6800640 1 --2- 172.21.15.142:0/3804920604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35c006d8d0 0x7f35c0145280 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.955+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 >> 172.21.15.142:0/3804920604 conn(0x7f35c00b5890 msgr2=0x7f35c013e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:08.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.955+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 shutdown_connections 2024-04-01T15:22:08.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:08.955+0000 7f35c6800640 1 -- 172.21.15.142:0/3804920604 wait complete. 2024-04-01T15:22:08.974 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-01T15:22:08.560546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003912"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374534+0000","last_change":"2024-04-01T15:21:58.539004+0000","last_active":"2024-04-01T15:22:00.374534+0000","last_peered":"2024-04-01T15:22:00.374534+0000","last_clean":"2024-04-01T15:22:00.374534+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:22:00.374534+0000","last_undegraded":"2024-04-01T15:22:00.374534+0000","last_fullsized":"2024-04-01T15:22:00.374534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525492+0000","last_change":"2024-04-01T15:21:58.524238+0000","last_active":"2024-04-01T15:21:59.525492+0000","last_peered":"2024-04-01T15:21:59.525492+0000","last_clean":"2024-04-01T15:21:59.525492+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:21:59.525492+0000","last_undegraded":"2024-04-01T15:21:59.525492+0000","last_fullsized":"2024-04-01T15:21:59.525492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795772+0000","last_change":"2024-04-01T15:21:58.526226+0000","last_active":"2024-04-01T15:22:00.795772+0000","last_peered":"2024-04-01T15:22:00.795772+0000","last_clean":"2024-04-01T15:22:00.795772+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:22:00.795772+0000","last_undegraded":"2024-04-01T15:22:00.795772+0000","last_fullsized":"2024-04-01T15:22:00.795772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528754+0000","last_change":"2024-04-01T15:21:58.541297+0000","last_active":"2024-04-01T15:21:59.528754+0000","last_peered":"2024-04-01T15:21:59.528754+0000","last_clean":"2024-04-01T15:21:59.528754+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:21:59.528754+0000","last_undegraded":"2024-04-01T15:21:59.528754+0000","last_fullsized":"2024-04-01T15:21:59.528754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374212+0000","last_change":"2024-04-01T15:21:58.518814+0000","last_active":"2024-04-01T15:22:00.374212+0000","last_peered":"2024-04-01T15:22:00.374212+0000","last_clean":"2024-04-01T15:22:00.374212+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:22:00.374212+0000","last_undegraded":"2024-04-01T15:22:00.374212+0000","last_fullsized":"2024-04-01T15:22:00.374212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528497+0000","last_change":"2024-04-01T15:21:58.519850+0000","last_active":"2024-04-01T15:21:59.528497+0000","last_peered":"2024-04-01T15:21:59.528497+0000","last_clean":"2024-04-01T15:21:59.528497+0000","last_became_active":"2024-04-01T15:21:58.519517+0000","last_became_peered":"2024-04-01T15:21:58.519517+0000","last_unstale":"2024-04-01T15:21:59.528497+0000","last_undegraded":"2024-04-01T15:21:59.528497+0000","last_fullsized":"2024-04-01T15:21:59.528497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374983+0000","last_change":"2024-04-01T15:21:58.522961+0000","last_active":"2024-04-01T15:22:00.374983+0000","last_peered":"2024-04-01T15:22:00.374983+0000","last_clean":"2024-04-01T15:22:00.374983+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:22:00.374983+0000","last_undegraded":"2024-04-01T15:22:00.374983+0000","last_fullsized":"2024-04-01T15:22:00.374983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:51:33.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696563+0000","last_change":"2024-04-01T15:21:58.530231+0000","last_active":"2024-04-01T15:21:59.696563+0000","last_peered":"2024-04-01T15:21:59.696563+0000","last_clean":"2024-04-01T15:21:59.696563+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:21:59.696563+0000","last_undegraded":"2024-04-01T15:21:59.696563+0000","last_fullsized":"2024-04-01T15:21:59.696563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374727+0000","last_change":"2024-04-01T15:21:58.526959+0000","last_active":"2024-04-01T15:22:00.374727+0000","last_peered":"2024-04-01T15:22:00.374727+0000","last_clean":"2024-04-01T15:22:00.374727+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:22:00.374727+0000","last_undegraded":"2024-04-01T15:22:00.374727+0000","last_fullsized":"2024-04-01T15:22:00.374727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175156+0000","last_change":"2024-04-01T15:21:58.529489+0000","last_active":"2024-04-01T15:22:00.175156+0000","last_peered":"2024-04-01T15:22:00.175156+0000","last_clean":"2024-04-01T15:22:00.175156+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:22:00.175156+0000","last_undegraded":"2024-04-01T15:22:00.175156+0000","last_fullsized":"2024-04-01T15:22:00.175156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174888+0000","last_change":"2024-04-01T15:21:58.527803+0000","last_active":"2024-04-01T15:22:00.174888+0000","last_peered":"2024-04-01T15:22:00.174888+0000","last_clean":"2024-04-01T15:22:00.174888+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:22:00.174888+0000","last_undegraded":"2024-04-01T15:22:00.174888+0000","last_fullsized":"2024-04-01T15:22:00.174888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525348+0000","last_change":"2024-04-01T15:21:58.535848+0000","last_active":"2024-04-01T15:21:59.525348+0000","last_peered":"2024-04-01T15:21:59.525348+0000","last_clean":"2024-04-01T15:21:59.525348+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:21:59.525348+0000","last_undegraded":"2024-04-01T15:21:59.525348+0000","last_fullsized":"2024-04-01T15:21:59.525348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697039+0000","last_change":"2024-04-01T15:21:58.528912+0000","last_active":"2024-04-01T15:21:59.697039+0000","last_peered":"2024-04-01T15:21:59.697039+0000","last_clean":"2024-04-01T15:21:59.697039+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:21:59.697039+0000","last_undegraded":"2024-04-01T15:21:59.697039+0000","last_fullsized":"2024-04-01T15:21:59.697039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795333+0000","last_change":"2024-04-01T15:21:58.529847+0000","last_active":"2024-04-01T15:22:00.795333+0000","last_peered":"2024-04-01T15:22:00.795333+0000","last_clean":"2024-04-01T15:22:00.795333+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:22:00.795333+0000","last_undegraded":"2024-04-01T15:22:00.795333+0000","last_fullsized":"2024-04-01T15:22:00.795333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:44:07.006946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524893+0000","last_change":"2024-04-01T15:21:58.535414+0000","last_active":"2024-04-01T15:21:59.524893+0000","last_peered":"2024-04-01T15:21:59.524893+0000","last_clean":"2024-04-01T15:21:59.524893+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:21:59.524893+0000","last_undegraded":"2024-04-01T15:21:59.524893+0000","last_fullsized":"2024-04-01T15:21:59.524893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528323+0000","last_change":"2024-04-01T15:21:58.522234+0000","last_active":"2024-04-01T15:21:59.528323+0000","last_peered":"2024-04-01T15:21:59.528323+0000","last_clean":"2024-04-01T15:21:59.528323+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:21:59.528323+0000","last_undegraded":"2024-04-01T15:21:59.528323+0000","last_fullsized":"2024-04-01T15:21:59.528323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.530918+0000","last_change":"2024-04-01T15:21:58.531397+0000","last_active":"2024-04-01T15:21:59.530918+0000","last_peered":"2024-04-01T15:21:59.530918+0000","last_clean":"2024-04-01T15:21:59.530918+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:21:59.530918+0000","last_undegraded":"2024-04-01T15:21:59.530918+0000","last_fullsized":"2024-04-01T15:21:59.530918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.040302+0000","last_change":"2024-04-01T15:21:58.522828+0000","last_active":"2024-04-01T15:22:00.040302+0000","last_peered":"2024-04-01T15:22:00.040302+0000","last_clean":"2024-04-01T15:22:00.040302+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:22:00.040302+0000","last_undegraded":"2024-04-01T15:22:00.040302+0000","last_fullsized":"2024-04-01T15:22:00.040302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373931+0000","last_change":"2024-04-01T15:21:58.532575+0000","last_active":"2024-04-01T15:22:00.373931+0000","last_peered":"2024-04-01T15:22:00.373931+0000","last_clean":"2024-04-01T15:22:00.373931+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:22:00.373931+0000","last_undegraded":"2024-04-01T15:22:00.373931+0000","last_fullsized":"2024-04-01T15:22:00.373931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174864+0000","last_change":"2024-04-01T15:21:58.530543+0000","last_active":"2024-04-01T15:22:00.174864+0000","last_peered":"2024-04-01T15:22:00.174864+0000","last_clean":"2024-04-01T15:22:00.174864+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:22:00.174864+0000","last_undegraded":"2024-04-01T15:22:00.174864+0000","last_fullsized":"2024-04-01T15:22:00.174864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795532+0000","last_change":"2024-04-01T15:21:58.528377+0000","last_active":"2024-04-01T15:22:00.795532+0000","last_peered":"2024-04-01T15:22:00.795532+0000","last_clean":"2024-04-01T15:22:00.795532+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:22:00.795532+0000","last_undegraded":"2024-04-01T15:22:00.795532+0000","last_fullsized":"2024-04-01T15:22:00.795532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:56:09.008728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528834+0000","last_change":"2024-04-01T15:21:58.530746+0000","last_active":"2024-04-01T15:21:59.528834+0000","last_peered":"2024-04-01T15:21:59.528834+0000","last_clean":"2024-04-01T15:21:59.528834+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:21:59.528834+0000","last_undegraded":"2024-04-01T15:21:59.528834+0000","last_fullsized":"2024-04-01T15:21:59.528834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696730+0000","last_change":"2024-04-01T15:21:58.516408+0000","last_active":"2024-04-01T15:21:59.696730+0000","last_peered":"2024-04-01T15:21:59.696730+0000","last_clean":"2024-04-01T15:21:59.696730+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:21:59.696730+0000","last_undegraded":"2024-04-01T15:21:59.696730+0000","last_fullsized":"2024-04-01T15:21:59.696730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528199+0000","last_change":"2024-04-01T15:21:58.525868+0000","last_active":"2024-04-01T15:21:59.528199+0000","last_peered":"2024-04-01T15:21:59.528199+0000","last_clean":"2024-04-01T15:21:59.528199+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:21:59.528199+0000","last_undegraded":"2024-04-01T15:21:59.528199+0000","last_fullsized":"2024-04-01T15:21:59.528199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697382+0000","last_change":"2024-04-01T15:21:58.531952+0000","last_active":"2024-04-01T15:21:59.697382+0000","last_peered":"2024-04-01T15:21:59.697382+0000","last_clean":"2024-04-01T15:21:59.697382+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:21:59.697382+0000","last_undegraded":"2024-04-01T15:21:59.697382+0000","last_fullsized":"2024-04-01T15:21:59.697382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175425+0000","last_change":"2024-04-01T15:21:58.517341+0000","last_active":"2024-04-01T15:22:00.175425+0000","last_peered":"2024-04-01T15:22:00.175425+0000","last_clean":"2024-04-01T15:22:00.175425+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:22:00.175425+0000","last_undegraded":"2024-04-01T15:22:00.175425+0000","last_fullsized":"2024-04-01T15:22:00.175425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525136+0000","last_change":"2024-04-01T15:21:58.535087+0000","last_active":"2024-04-01T15:21:59.525136+0000","last_peered":"2024-04-01T15:21:59.525136+0000","last_clean":"2024-04-01T15:21:59.525136+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:21:59.525136+0000","last_undegraded":"2024-04-01T15:21:59.525136+0000","last_fullsized":"2024-04-01T15:21:59.525136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697491+0000","last_change":"2024-04-01T15:21:58.531487+0000","last_active":"2024-04-01T15:21:59.697491+0000","last_peered":"2024-04-01T15:21:59.697491+0000","last_clean":"2024-04-01T15:21:59.697491+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:21:59.697491+0000","last_undegraded":"2024-04-01T15:21:59.697491+0000","last_fullsized":"2024-04-01T15:21:59.697491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795574+0000","last_change":"2024-04-01T15:21:58.531305+0000","last_active":"2024-04-01T15:22:00.795574+0000","last_peered":"2024-04-01T15:22:00.795574+0000","last_clean":"2024-04-01T15:22:00.795574+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:22:00.795574+0000","last_undegraded":"2024-04-01T15:22:00.795574+0000","last_fullsized":"2024-04-01T15:22:00.795574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528885+0000","last_change":"2024-04-01T15:21:58.530998+0000","last_active":"2024-04-01T15:21:59.528885+0000","last_peered":"2024-04-01T15:21:59.528885+0000","last_clean":"2024-04-01T15:21:59.528885+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:21:59.528885+0000","last_undegraded":"2024-04-01T15:21:59.528885+0000","last_fullsized":"2024-04-01T15:21:59.528885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039960+0000","last_change":"2024-04-01T15:21:58.523119+0000","last_active":"2024-04-01T15:22:00.039960+0000","last_peered":"2024-04-01T15:22:00.039960+0000","last_clean":"2024-04-01T15:22:00.039960+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:22:00.039960+0000","last_undegraded":"2024-04-01T15:22:00.039960+0000","last_fullsized":"2024-04-01T15:22:00.039960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174268+0000","last_change":"2024-04-01T15:21:58.514302+0000","last_active":"2024-04-01T15:22:00.174268+0000","last_peered":"2024-04-01T15:22:00.174268+0000","last_clean":"2024-04-01T15:22:00.174268+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:22:00.174268+0000","last_undegraded":"2024-04-01T15:22:00.174268+0000","last_fullsized":"2024-04-01T15:22:00.174268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524902+0000","last_change":"2024-04-01T15:21:58.528525+0000","last_active":"2024-04-01T15:21:59.524902+0000","last_peered":"2024-04-01T15:21:59.524902+0000","last_clean":"2024-04-01T15:21:59.524902+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:21:59.524902+0000","last_undegraded":"2024-04-01T15:21:59.524902+0000","last_fullsized":"2024-04-01T15:21:59.524902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:58.054203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697111+0000","last_change":"2024-04-01T15:21:57.523557+0000","last_active":"2024-04-01T15:21:59.697111+0000","last_peered":"2024-04-01T15:21:59.697111+0000","last_clean":"2024-04-01T15:21:59.697111+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:21:59.697111+0000","last_undegraded":"2024-04-01T15:21:59.697111+0000","last_fullsized":"2024-04-01T15:21:59.697111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795700+0000","last_change":"2024-04-01T15:21:58.531570+0000","last_active":"2024-04-01T15:22:00.795700+0000","last_peered":"2024-04-01T15:22:00.795700+0000","last_clean":"2024-04-01T15:22:00.795700+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:22:00.795700+0000","last_undegraded":"2024-04-01T15:22:00.795700+0000","last_fullsized":"2024-04-01T15:22:00.795700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174511+0000","last_change":"2024-04-01T15:21:57.519248+0000","last_active":"2024-04-01T15:22:00.174511+0000","last_peered":"2024-04-01T15:22:00.174511+0000","last_clean":"2024-04-01T15:22:00.174511+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:22:00.174511+0000","last_undegraded":"2024-04-01T15:22:00.174511+0000","last_fullsized":"2024-04-01T15:22:00.174511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696520+0000","last_change":"2024-04-01T15:21:57.518727+0000","last_active":"2024-04-01T15:21:59.696520+0000","last_peered":"2024-04-01T15:21:59.696520+0000","last_clean":"2024-04-01T15:21:59.696520+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:21:59.696520+0000","last_undegraded":"2024-04-01T15:21:59.696520+0000","last_fullsized":"2024-04-01T15:21:59.696520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:15:36.993209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696524+0000","last_change":"2024-04-01T15:21:58.527894+0000","last_active":"2024-04-01T15:21:59.696524+0000","last_peered":"2024-04-01T15:21:59.696524+0000","last_clean":"2024-04-01T15:21:59.696524+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:21:59.696524+0000","last_undegraded":"2024-04-01T15:21:59.696524+0000","last_fullsized":"2024-04-01T15:21:59.696524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528268+0000","last_change":"2024-04-01T15:21:57.534982+0000","last_active":"2024-04-01T15:21:59.528268+0000","last_peered":"2024-04-01T15:21:59.528268+0000","last_clean":"2024-04-01T15:21:59.528268+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:21:59.528268+0000","last_undegraded":"2024-04-01T15:21:59.528268+0000","last_fullsized":"2024-04-01T15:21:59.528268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524398+0000","last_change":"2024-04-01T15:21:58.525017+0000","last_active":"2024-04-01T15:21:59.524398+0000","last_peered":"2024-04-01T15:21:59.524398+0000","last_clean":"2024-04-01T15:21:59.524398+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:21:59.524398+0000","last_undegraded":"2024-04-01T15:21:59.524398+0000","last_fullsized":"2024-04-01T15:21:59.524398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175037+0000","last_change":"2024-04-01T15:21:57.528840+0000","last_active":"2024-04-01T15:22:00.175037+0000","last_peered":"2024-04-01T15:22:00.175037+0000","last_clean":"2024-04-01T15:22:00.175037+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:22:00.175037+0000","last_undegraded":"2024-04-01T15:22:00.175037+0000","last_fullsized":"2024-04-01T15:22:00.175037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529666+0000","last_change":"2024-04-01T15:21:58.529422+0000","last_active":"2024-04-01T15:21:59.529666+0000","last_peered":"2024-04-01T15:21:59.529666+0000","last_clean":"2024-04-01T15:21:59.529666+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:21:59.529666+0000","last_undegraded":"2024-04-01T15:21:59.529666+0000","last_fullsized":"2024-04-01T15:21:59.529666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529803+0000","last_change":"2024-04-01T15:21:57.528345+0000","last_active":"2024-04-01T15:21:59.529803+0000","last_peered":"2024-04-01T15:21:59.529803+0000","last_clean":"2024-04-01T15:21:59.529803+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:21:59.529803+0000","last_undegraded":"2024-04-01T15:21:59.529803+0000","last_fullsized":"2024-04-01T15:21:59.529803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795783+0000","last_change":"2024-04-01T15:21:58.529376+0000","last_active":"2024-04-01T15:22:00.795783+0000","last_peered":"2024-04-01T15:22:00.795783+0000","last_clean":"2024-04-01T15:22:00.795783+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:22:00.795783+0000","last_undegraded":"2024-04-01T15:22:00.795783+0000","last_fullsized":"2024-04-01T15:22:00.795783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524861+0000","last_change":"2024-04-01T15:21:57.526610+0000","last_active":"2024-04-01T15:21:59.524861+0000","last_peered":"2024-04-01T15:21:59.524861+0000","last_clean":"2024-04-01T15:21:59.524861+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:21:59.524861+0000","last_undegraded":"2024-04-01T15:21:59.524861+0000","last_fullsized":"2024-04-01T15:21:59.524861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525355+0000","last_change":"2024-04-01T15:21:58.537476+0000","last_active":"2024-04-01T15:21:59.525355+0000","last_peered":"2024-04-01T15:21:59.525355+0000","last_clean":"2024-04-01T15:21:59.525355+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:21:59.525355+0000","last_undegraded":"2024-04-01T15:21:59.525355+0000","last_fullsized":"2024-04-01T15:21:59.525355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174501+0000","last_change":"2024-04-01T15:21:57.513766+0000","last_active":"2024-04-01T15:22:00.174501+0000","last_peered":"2024-04-01T15:22:00.174501+0000","last_clean":"2024-04-01T15:22:00.174501+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:22:00.174501+0000","last_undegraded":"2024-04-01T15:22:00.174501+0000","last_fullsized":"2024-04-01T15:22:00.174501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373572+0000","last_change":"2024-04-01T15:21:58.539751+0000","last_active":"2024-04-01T15:22:00.373572+0000","last_peered":"2024-04-01T15:22:00.373572+0000","last_clean":"2024-04-01T15:22:00.373572+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:22:00.373572+0000","last_undegraded":"2024-04-01T15:22:00.373572+0000","last_fullsized":"2024-04-01T15:22:00.373572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795635+0000","last_change":"2024-04-01T15:21:57.520158+0000","last_active":"2024-04-01T15:22:00.795635+0000","last_peered":"2024-04-01T15:22:00.795635+0000","last_clean":"2024-04-01T15:22:00.795635+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:22:00.795635+0000","last_undegraded":"2024-04-01T15:22:00.795635+0000","last_fullsized":"2024-04-01T15:22:00.795635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795381+0000","last_change":"2024-04-01T15:21:58.532249+0000","last_active":"2024-04-01T15:22:00.795381+0000","last_peered":"2024-04-01T15:22:00.795381+0000","last_clean":"2024-04-01T15:22:00.795381+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:22:00.795381+0000","last_undegraded":"2024-04-01T15:22:00.795381+0000","last_fullsized":"2024-04-01T15:22:00.795381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.229948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529411+0000","last_change":"2024-04-01T15:21:57.528780+0000","last_active":"2024-04-01T15:21:59.529411+0000","last_peered":"2024-04-01T15:21:59.529411+0000","last_clean":"2024-04-01T15:21:59.529411+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:21:59.529411+0000","last_undegraded":"2024-04-01T15:21:59.529411+0000","last_fullsized":"2024-04-01T15:21:59.529411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374292+0000","last_change":"2024-04-01T15:21:58.528458+0000","last_active":"2024-04-01T15:22:00.374292+0000","last_peered":"2024-04-01T15:22:00.374292+0000","last_clean":"2024-04-01T15:22:00.374292+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:22:00.374292+0000","last_undegraded":"2024-04-01T15:22:00.374292+0000","last_fullsized":"2024-04-01T15:22:00.374292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174063+0000","last_change":"2024-04-01T15:21:57.528026+0000","last_active":"2024-04-01T15:22:00.174063+0000","last_peered":"2024-04-01T15:22:00.174063+0000","last_clean":"2024-04-01T15:22:00.174063+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:22:00.174063+0000","last_undegraded":"2024-04-01T15:22:00.174063+0000","last_fullsized":"2024-04-01T15:22:00.174063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174372+0000","last_change":"2024-04-01T15:21:58.514047+0000","last_active":"2024-04-01T15:22:00.174372+0000","last_peered":"2024-04-01T15:22:00.174372+0000","last_clean":"2024-04-01T15:22:00.174372+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:22:00.174372+0000","last_undegraded":"2024-04-01T15:22:00.174372+0000","last_fullsized":"2024-04-01T15:22:00.174372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039609+0000","last_change":"2024-04-01T15:21:57.517184+0000","last_active":"2024-04-01T15:22:00.039609+0000","last_peered":"2024-04-01T15:22:00.039609+0000","last_clean":"2024-04-01T15:22:00.039609+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:22:00.039609+0000","last_undegraded":"2024-04-01T15:22:00.039609+0000","last_fullsized":"2024-04-01T15:22:00.039609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374874+0000","last_change":"2024-04-01T15:21:58.529946+0000","last_active":"2024-04-01T15:22:00.374874+0000","last_peered":"2024-04-01T15:22:00.374874+0000","last_clean":"2024-04-01T15:22:00.374874+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:22:00.374874+0000","last_undegraded":"2024-04-01T15:22:00.374874+0000","last_fullsized":"2024-04-01T15:22:00.374874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525712+0000","last_change":"2024-04-01T15:21:57.519642+0000","last_active":"2024-04-01T15:21:59.525712+0000","last_peered":"2024-04-01T15:21:59.525712+0000","last_clean":"2024-04-01T15:21:59.525712+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:21:59.525712+0000","last_undegraded":"2024-04-01T15:21:59.525712+0000","last_fullsized":"2024-04-01T15:21:59.525712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:09:07.894019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374100+0000","last_change":"2024-04-01T15:21:58.529121+0000","last_active":"2024-04-01T15:22:00.374100+0000","last_peered":"2024-04-01T15:22:00.374100+0000","last_clean":"2024-04-01T15:22:00.374100+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:22:00.374100+0000","last_undegraded":"2024-04-01T15:22:00.374100+0000","last_fullsized":"2024-04-01T15:22:00.374100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039988+0000","last_change":"2024-04-01T15:21:57.514455+0000","last_active":"2024-04-01T15:22:00.039988+0000","last_peered":"2024-04-01T15:22:00.039988+0000","last_clean":"2024-04-01T15:22:00.039988+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:22:00.039988+0000","last_undegraded":"2024-04-01T15:22:00.039988+0000","last_fullsized":"2024-04-01T15:22:00.039988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374717+0000","last_change":"2024-04-01T15:21:58.535610+0000","last_active":"2024-04-01T15:22:00.374717+0000","last_peered":"2024-04-01T15:22:00.374717+0000","last_clean":"2024-04-01T15:22:00.374717+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:22:00.374717+0000","last_undegraded":"2024-04-01T15:22:00.374717+0000","last_fullsized":"2024-04-01T15:22:00.374717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524990+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:21:59.524990+0000","last_peered":"2024-04-01T15:21:59.524990+0000","last_clean":"2024-04-01T15:21:59.524990+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:21:59.524990+0000","last_undegraded":"2024-04-01T15:21:59.524990+0000","last_fullsized":"2024-04-01T15:21:59.524990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529157+0000","last_change":"2024-04-01T15:21:58.533365+0000","last_active":"2024-04-01T15:21:59.529157+0000","last_peered":"2024-04-01T15:21:59.529157+0000","last_clean":"2024-04-01T15:21:59.529157+0000","last_became_active":"2024-04-01T15:21:58.533141+0000","last_became_peered":"2024-04-01T15:21:58.533141+0000","last_unstale":"2024-04-01T15:21:59.529157+0000","last_undegraded":"2024-04-01T15:21:59.529157+0000","last_fullsized":"2024-04-01T15:21:59.529157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.039888+0000","last_change":"2024-04-01T15:21:57.532167+0000","last_active":"2024-04-01T15:22:00.039888+0000","last_peered":"2024-04-01T15:22:00.039888+0000","last_clean":"2024-04-01T15:22:00.039888+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:22:00.039888+0000","last_undegraded":"2024-04-01T15:22:00.039888+0000","last_fullsized":"2024-04-01T15:22:00.039888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373757+0000","last_change":"2024-04-01T15:21:58.530108+0000","last_active":"2024-04-01T15:22:00.373757+0000","last_peered":"2024-04-01T15:22:00.373757+0000","last_clean":"2024-04-01T15:22:00.373757+0000","last_became_active":"2024-04-01T15:21:58.529794+0000","last_became_peered":"2024-04-01T15:21:58.529794+0000","last_unstale":"2024-04-01T15:22:00.373757+0000","last_undegraded":"2024-04-01T15:22:00.373757+0000","last_fullsized":"2024-04-01T15:22:00.373757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373799+0000","last_change":"2024-04-01T15:21:47.878530+0000","last_active":"2024-04-01T15:22:00.373799+0000","last_peered":"2024-04-01T15:22:00.373799+0000","last_clean":"2024-04-01T15:22:00.373799+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:22:00.373799+0000","last_undegraded":"2024-04-01T15:22:00.373799+0000","last_fullsized":"2024-04-01T15:22:00.373799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_clean_scrub_stamp":"2024-04-01T15:21:46.852307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:25:18.137507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528321+0000","last_change":"2024-04-01T15:21:57.530394+0000","last_active":"2024-04-01T15:21:59.528321+0000","last_peered":"2024-04-01T15:21:59.528321+0000","last_clean":"2024-04-01T15:21:59.528321+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:21:59.528321+0000","last_undegraded":"2024-04-01T15:21:59.528321+0000","last_fullsized":"2024-04-01T15:21:59.528321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697106+0000","last_change":"2024-04-01T15:21:58.529751+0000","last_active":"2024-04-01T15:21:59.697106+0000","last_peered":"2024-04-01T15:21:59.697106+0000","last_clean":"2024-04-01T15:21:59.697106+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:21:59.697106+0000","last_undegraded":"2024-04-01T15:21:59.697106+0000","last_fullsized":"2024-04-01T15:21:59.697106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373518+0000","last_change":"2024-04-01T15:21:57.526919+0000","last_active":"2024-04-01T15:22:00.373518+0000","last_peered":"2024-04-01T15:22:00.373518+0000","last_clean":"2024-04-01T15:22:00.373518+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:22:00.373518+0000","last_undegraded":"2024-04-01T15:22:00.373518+0000","last_fullsized":"2024-04-01T15:22:00.373518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.796128+0000","last_change":"2024-04-01T15:21:58.525329+0000","last_active":"2024-04-01T15:22:00.796128+0000","last_peered":"2024-04-01T15:22:00.796128+0000","last_clean":"2024-04-01T15:22:00.796128+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:22:00.796128+0000","last_undegraded":"2024-04-01T15:22:00.796128+0000","last_fullsized":"2024-04-01T15:22:00.796128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.040177+0000","last_change":"2024-04-01T15:21:57.511176+0000","last_active":"2024-04-01T15:22:00.040177+0000","last_peered":"2024-04-01T15:22:00.040177+0000","last_clean":"2024-04-01T15:22:00.040177+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:22:00.040177+0000","last_undegraded":"2024-04-01T15:22:00.040177+0000","last_fullsized":"2024-04-01T15:22:00.040177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524559+0000","last_change":"2024-04-01T15:21:58.523794+0000","last_active":"2024-04-01T15:21:59.524559+0000","last_peered":"2024-04-01T15:21:59.524559+0000","last_clean":"2024-04-01T15:21:59.524559+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:21:59.524559+0000","last_undegraded":"2024-04-01T15:21:59.524559+0000","last_fullsized":"2024-04-01T15:21:59.524559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529840+0000","last_change":"2024-04-01T15:21:57.527763+0000","last_active":"2024-04-01T15:21:59.529840+0000","last_peered":"2024-04-01T15:21:59.529840+0000","last_clean":"2024-04-01T15:21:59.529840+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:21:59.529840+0000","last_undegraded":"2024-04-01T15:21:59.529840+0000","last_fullsized":"2024-04-01T15:21:59.529840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524921+0000","last_change":"2024-04-01T15:21:58.531026+0000","last_active":"2024-04-01T15:21:59.524921+0000","last_peered":"2024-04-01T15:21:59.524921+0000","last_clean":"2024-04-01T15:21:59.524921+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:21:59.524921+0000","last_undegraded":"2024-04-01T15:21:59.524921+0000","last_fullsized":"2024-04-01T15:21:59.524921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:50.706762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524830+0000","last_change":"2024-04-01T15:21:57.517159+0000","last_active":"2024-04-01T15:21:59.524830+0000","last_peered":"2024-04-01T15:21:59.524830+0000","last_clean":"2024-04-01T15:21:59.524830+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:21:59.524830+0000","last_undegraded":"2024-04-01T15:21:59.524830+0000","last_fullsized":"2024-04-01T15:21:59.524830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529965+0000","last_change":"2024-04-01T15:21:58.541348+0000","last_active":"2024-04-01T15:21:59.529965+0000","last_peered":"2024-04-01T15:21:59.529965+0000","last_clean":"2024-04-01T15:21:59.529965+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:21:59.529965+0000","last_undegraded":"2024-04-01T15:21:59.529965+0000","last_fullsized":"2024-04-01T15:21:59.529965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373995+0000","last_change":"2024-04-01T15:21:57.526914+0000","last_active":"2024-04-01T15:22:00.373995+0000","last_peered":"2024-04-01T15:22:00.373995+0000","last_clean":"2024-04-01T15:22:00.373995+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:22:00.373995+0000","last_undegraded":"2024-04-01T15:22:00.373995+0000","last_fullsized":"2024-04-01T15:22:00.373995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524661+0000","last_change":"2024-04-01T15:21:58.515834+0000","last_active":"2024-04-01T15:21:59.524661+0000","last_peered":"2024-04-01T15:21:59.524661+0000","last_clean":"2024-04-01T15:21:59.524661+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:21:59.524661+0000","last_undegraded":"2024-04-01T15:21:59.524661+0000","last_fullsized":"2024-04-01T15:21:59.524661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525272+0000","last_change":"2024-04-01T15:21:57.533452+0000","last_active":"2024-04-01T15:21:59.525272+0000","last_peered":"2024-04-01T15:21:59.525272+0000","last_clean":"2024-04-01T15:21:59.525272+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:21:59.525272+0000","last_undegraded":"2024-04-01T15:21:59.525272+0000","last_fullsized":"2024-04-01T15:21:59.525272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697608+0000","last_change":"2024-04-01T15:21:58.512191+0000","last_active":"2024-04-01T15:21:59.697608+0000","last_peered":"2024-04-01T15:21:59.697608+0000","last_clean":"2024-04-01T15:21:59.697608+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:21:59.697608+0000","last_undegraded":"2024-04-01T15:21:59.697608+0000","last_fullsized":"2024-04-01T15:21:59.697608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.175206+0000","last_change":"2024-04-01T15:21:57.526196+0000","last_active":"2024-04-01T15:22:00.175206+0000","last_peered":"2024-04-01T15:22:00.175206+0000","last_clean":"2024-04-01T15:22:00.175206+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:22:00.175206+0000","last_undegraded":"2024-04-01T15:22:00.175206+0000","last_fullsized":"2024-04-01T15:22:00.175206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795819+0000","last_change":"2024-04-01T15:21:58.526739+0000","last_active":"2024-04-01T15:22:00.795819+0000","last_peered":"2024-04-01T15:22:00.795819+0000","last_clean":"2024-04-01T15:22:00.795819+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:22:00.795819+0000","last_undegraded":"2024-04-01T15:22:00.795819+0000","last_fullsized":"2024-04-01T15:22:00.795819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373249+0000","last_change":"2024-04-01T15:21:57.526924+0000","last_active":"2024-04-01T15:22:00.373249+0000","last_peered":"2024-04-01T15:22:00.373249+0000","last_clean":"2024-04-01T15:22:00.373249+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:22:00.373249+0000","last_undegraded":"2024-04-01T15:22:00.373249+0000","last_fullsized":"2024-04-01T15:22:00.373249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524505+0000","last_change":"2024-04-01T15:21:58.528396+0000","last_active":"2024-04-01T15:21:59.524505+0000","last_peered":"2024-04-01T15:21:59.524505+0000","last_clean":"2024-04-01T15:21:59.524505+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:21:59.524505+0000","last_undegraded":"2024-04-01T15:21:59.524505+0000","last_fullsized":"2024-04-01T15:21:59.524505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:50.943225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.525048+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:21:59.525048+0000","last_peered":"2024-04-01T15:21:59.525048+0000","last_clean":"2024-04-01T15:21:59.525048+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:21:59.525048+0000","last_undegraded":"2024-04-01T15:21:59.525048+0000","last_fullsized":"2024-04-01T15:21:59.525048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:09.572891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.696891+0000","last_change":"2024-04-01T15:21:58.529955+0000","last_active":"2024-04-01T15:21:59.696891+0000","last_peered":"2024-04-01T15:21:59.696891+0000","last_clean":"2024-04-01T15:21:59.696891+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:21:59.696891+0000","last_undegraded":"2024-04-01T15:21:59.696891+0000","last_fullsized":"2024-04-01T15:21:59.696891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.524416+0000","last_change":"2024-04-01T15:21:57.526620+0000","last_active":"2024-04-01T15:21:59.524416+0000","last_peered":"2024-04-01T15:21:59.524416+0000","last_clean":"2024-04-01T15:21:59.524416+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:21:59.524416+0000","last_undegraded":"2024-04-01T15:21:59.524416+0000","last_fullsized":"2024-04-01T15:21:59.524416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697310+0000","last_change":"2024-04-01T15:21:58.534484+0000","last_active":"2024-04-01T15:21:59.697310+0000","last_peered":"2024-04-01T15:21:59.697310+0000","last_clean":"2024-04-01T15:21:59.697310+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:21:59.697310+0000","last_undegraded":"2024-04-01T15:21:59.697310+0000","last_fullsized":"2024-04-01T15:21:59.697310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.374424+0000","last_change":"2024-04-01T15:21:57.531639+0000","last_active":"2024-04-01T15:22:00.374424+0000","last_peered":"2024-04-01T15:22:00.374424+0000","last_clean":"2024-04-01T15:22:00.374424+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:22:00.374424+0000","last_undegraded":"2024-04-01T15:22:00.374424+0000","last_fullsized":"2024-04-01T15:22:00.374424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.174380+0000","last_change":"2024-04-01T15:21:58.523366+0000","last_active":"2024-04-01T15:22:00.174380+0000","last_peered":"2024-04-01T15:22:00.174380+0000","last_clean":"2024-04-01T15:22:00.174380+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:22:00.174380+0000","last_undegraded":"2024-04-01T15:22:00.174380+0000","last_fullsized":"2024-04-01T15:22:00.174380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.529585+0000","last_change":"2024-04-01T15:21:58.526457+0000","last_active":"2024-04-01T15:21:59.529585+0000","last_peered":"2024-04-01T15:21:59.529585+0000","last_clean":"2024-04-01T15:21:59.529585+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:21:59.529585+0000","last_undegraded":"2024-04-01T15:21:59.529585+0000","last_fullsized":"2024-04-01T15:21:59.529585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373310+0000","last_change":"2024-04-01T15:21:57.534510+0000","last_active":"2024-04-01T15:22:00.373310+0000","last_peered":"2024-04-01T15:22:00.373310+0000","last_clean":"2024-04-01T15:22:00.373310+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:22:00.373310+0000","last_undegraded":"2024-04-01T15:22:00.373310+0000","last_fullsized":"2024-04-01T15:22:00.373310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.528978+0000","last_change":"2024-04-01T15:21:58.537101+0000","last_active":"2024-04-01T15:21:59.528978+0000","last_peered":"2024-04-01T15:21:59.528978+0000","last_clean":"2024-04-01T15:21:59.528978+0000","last_became_active":"2024-04-01T15:21:58.536776+0000","last_became_peered":"2024-04-01T15:21:58.536776+0000","last_unstale":"2024-04-01T15:21:59.528978+0000","last_undegraded":"2024-04-01T15:21:59.528978+0000","last_fullsized":"2024-04-01T15:21:59.528978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.373757+0000","last_change":"2024-04-01T15:21:57.533797+0000","last_active":"2024-04-01T15:22:00.373757+0000","last_peered":"2024-04-01T15:22:00.373757+0000","last_clean":"2024-04-01T15:22:00.373757+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:22:00.373757+0000","last_undegraded":"2024-04-01T15:22:00.373757+0000","last_fullsized":"2024-04-01T15:22:00.373757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:16:16.205030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795639+0000","last_change":"2024-04-01T15:21:58.524922+0000","last_active":"2024-04-01T15:22:00.795639+0000","last_peered":"2024-04-01T15:22:00.795639+0000","last_clean":"2024-04-01T15:22:00.795639+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:22:00.795639+0000","last_undegraded":"2024-04-01T15:22:00.795639+0000","last_fullsized":"2024-04-01T15:22:00.795639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697725+0000","last_change":"2024-04-01T15:21:57.518934+0000","last_active":"2024-04-01T15:21:59.697725+0000","last_peered":"2024-04-01T15:21:59.697725+0000","last_clean":"2024-04-01T15:21:59.697725+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:21:59.697725+0000","last_undegraded":"2024-04-01T15:21:59.697725+0000","last_fullsized":"2024-04-01T15:21:59.697725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:21:59.697866+0000","last_change":"2024-04-01T15:21:58.538259+0000","last_active":"2024-04-01T15:21:59.697866+0000","last_peered":"2024-04-01T15:21:59.697866+0000","last_clean":"2024-04-01T15:21:59.697866+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:21:59.697866+0000","last_undegraded":"2024-04-01T15:21:59.697866+0000","last_fullsized":"2024-04-01T15:21:59.697866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-01T15:22:00.795827+0000","last_change":"2024-04-01T15:21:57.524507+0000","last_active":"2024-04-01T15:22:00.795827+0000","last_peered":"2024-04-01T15:22:00.795827+0000","last_clean":"2024-04-01T15:22:00.795827+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:22:00.795827+0000","last_undegraded":"2024-04-01T15:22:00.795827+0000","last_fullsized":"2024-04-01T15:22:00.795827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:29:44.659776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:22:08.977 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-01T15:22:08.977 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-01T15:22:08.977 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-01T15:22:08.977 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-01T15:22:09.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.212+0000 7ff694a00640 1 Processor -- start 2024-04-01T15:22:09.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.212+0000 7ff694a00640 1 -- start start 2024-04-01T15:22:09.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.213+0000 7ff694a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff69006d8d0 0x7ff6900b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff694a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6900b1410 0x7ff69014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff694a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69006dcb0 con 0x7ff6900b0fb0 2024-04-01T15:22:09.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff694a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff6900b0b20 con 0x7ff69006d8d0 2024-04-01T15:22:09.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff694a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff690148ad0 con 0x7ff6900b1410 2024-04-01T15:22:09.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff68d400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff6900b0fb0 0x7ff6901491e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44372/0 (socket says 172.21.15.142:44372) 2024-04-01T15:22:09.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff68d400640 1 -- 172.21.15.142:0/1272422799 learned_addr learned my addr 172.21.15.142:0/1272422799 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff68de00640 1 --2- 172.21.15.142:0/1272422799 >> v2:172.21.15.179:3300/0 conn(0x7ff69006d8d0 0x7ff6900b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff68e800640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6900b1410 0x7ff69014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015850640 0 0) 0x7ff69006dcb0 con 0x7ff6900b0fb0 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.214+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff674003520 con 0x7ff6900b0fb0 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3433880708 0 0) 0x7ff674003520 con 0x7ff6900b0fb0 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6900b1410 msgr2=0x7ff69014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6900b1410 0x7ff69014fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 >> v2:172.21.15.179:3300/0 conn(0x7ff69006d8d0 msgr2=0x7ff6900b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 --2- 172.21.15.142:0/1272422799 >> v2:172.21.15.179:3300/0 conn(0x7ff69006d8d0 0x7ff6900b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6900b5230 con 0x7ff6900b0fb0 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7ff67c0019f0 con 0x7ff6900b0fb0 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 >> v1:172.21.15.142:6789/0 conn(0x7ff6900b0fb0 legacy=0x7ff6901491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6900b1410 0x7ff6740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff674003f30 0x7ff674004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff674004d40 0x7ff6740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff6900b0b20 con 0x7ff674003f30 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff690148ad0 con 0x7ff674004d40 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff67400b9c0 con 0x7ff6900b1410 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68d400640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff674003f30 0x7ff674004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68de00640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6900b1410 0x7ff6740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.215+0000 7ff68e800640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff674004d40 0x7ff6740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.216+0000 7ff68d400640 1 -- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6900b1410 msgr2=0x7ff6740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.216+0000 7ff68d400640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6900b1410 0x7ff6740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.216+0000 7ff68d400640 1 -- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff674004d40 msgr2=0x7ff6740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.216+0000 7ff68d400640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff674004d40 0x7ff6740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.216+0000 7ff68d400640 1 -- 172.21.15.142:0/1272422799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff674003520 con 0x7ff674003f30 2024-04-01T15:22:09.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.216+0000 7ff68e800640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff674004d40 0x7ff6740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.217+0000 7ff68d400640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff674003f30 0x7ff674004800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00a920 tx=0x7ff674005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab2637cc07d8c6c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.217+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00a4c0 con 0x7ff674003f30 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.217+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67c034650 con 0x7ff674003f30 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.217+0000 7ff68ca00640 1 -- 172.21.15.142:0/1272422799 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c034a80 con 0x7ff674003f30 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.217+0000 7ff694a00640 1 -- 172.21.15.142:0/1272422799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff674003f30 msgr2=0x7ff674004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.217+0000 7ff694a00640 1 --2- 172.21.15.142:0/1272422799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff674003f30 0x7ff674004800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00a920 tx=0x7ff674005830 comp rx=0 tx=0).stop 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.217+0000 7ff68e800640 1 -- 172.21.15.142:0/1272422799 reap_dead start 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.218+0000 7ff694a00640 1 -- 172.21.15.142:0/1272422799 shutdown_connections 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.218+0000 7ff694a00640 1 -- 172.21.15.142:0/1272422799 >> 172.21.15.142:0/1272422799 conn(0x7ff6900b5890 msgr2=0x7ff6900b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.218+0000 7ff694a00640 1 -- 172.21.15.142:0/1272422799 shutdown_connections 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.218+0000 7ff694a00640 1 -- 172.21.15.142:0/1272422799 wait complete. 2024-04-01T15:22:09.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.219+0000 7ff694a00640 1 Processor -- start 2024-04-01T15:22:09.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.219+0000 7ff694a00640 1 -- start start 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff694a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff674003f30 0x7ff690148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff694a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff690141eb0 0x7ff6901db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff694a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6901db5f0 0x7ff69013ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff694a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff6901498f0 con 0x7ff690141eb0 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff694a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6900b4e50 con 0x7ff6901db5f0 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff694a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff690070950 con 0x7ff674003f30 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff68d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff690141eb0 0x7ff6901db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff68d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff690141eb0 0x7ff6901db0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51454/0 (socket says 172.21.15.142:51454) 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff68d400640 1 -- 172.21.15.142:0/3211541092 learned_addr learned my addr 172.21.15.142:0/3211541092 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.220+0000 7ff68de00640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff674003f30 0x7ff690148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff68e800640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6901db5f0 0x7ff69013ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff68d400640 1 -- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff674003f30 msgr2=0x7ff690148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff68d400640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff674003f30 0x7ff690148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff68d400640 1 -- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6901db5f0 msgr2=0x7ff69013ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff68d400640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6901db5f0 0x7ff69013ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff68d400640 1 -- 172.21.15.142:0/3211541092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff690142e70 con 0x7ff690141eb0 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff68e800640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6901db5f0 0x7ff69013ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff68d400640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff690141eb0 0x7ff6901db0b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00a920 tx=0x7ff6901454e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff686000640 1 -- 172.21.15.142:0/3211541092 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c045070 con 0x7ff690141eb0 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff686000640 1 -- 172.21.15.142:0/3211541092 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67c03a040 con 0x7ff690141eb0 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff686000640 1 -- 172.21.15.142:0/3211541092 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c004e30 con 0x7ff690141eb0 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff690141ac0 con 0x7ff690141eb0 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.221+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6901dba70 con 0x7ff690141eb0 2024-04-01T15:22:09.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.222+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6901418b0 con 0x7ff690141eb0 2024-04-01T15:22:09.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.223+0000 7ff686000640 1 -- 172.21.15.142:0/3211541092 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff67c034650 con 0x7ff690141eb0 2024-04-01T15:22:09.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.224+0000 7ff686000640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff67006c8f0 0x7ff67006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.224+0000 7ff686000640 1 -- 172.21.15.142:0/3211541092 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff67c0ad3e0 con 0x7ff690141eb0 2024-04-01T15:22:09.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.224+0000 7ff68de00640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff67006c8f0 0x7ff67006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.225+0000 7ff68de00640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff67006c8f0 0x7ff67006edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff680009a90 tx=0x7ff680008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:09.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.228+0000 7ff686000640 1 -- 172.21.15.142:0/3211541092 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff67c07b1b0 con 0x7ff690141eb0 2024-04-01T15:22:09.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.450+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff690068710 con 0x7ff690141eb0 2024-04-01T15:22:09.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.450+0000 7ff686000640 1 -- 172.21.15.142:0/3211541092 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff67c07f4b0 con 0x7ff690141eb0 2024-04-01T15:22:09.452 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:09.452 INFO:teuthology.orchestra.run.smithi142.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff67006c8f0 msgr2=0x7ff67006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff67006c8f0 0x7ff67006edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff680009a90 tx=0x7ff680008040 comp rx=0 tx=0).stop 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff690141eb0 msgr2=0x7ff6901db0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff690141eb0 0x7ff6901db0b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00a920 tx=0x7ff6901454e0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 shutdown_connections 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff67006c8f0 0x7ff67006edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6901db5f0 0x7ff69013ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff690141eb0 0x7ff6901db0b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 --2- 172.21.15.142:0/3211541092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff674003f30 0x7ff690148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 >> 172.21.15.142:0/3211541092 conn(0x7ff6900b5890 msgr2=0x7ff69013e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 shutdown_connections 2024-04-01T15:22:09.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.453+0000 7ff694a00640 1 -- 172.21.15.142:0/3211541092 wait complete. 2024-04-01T15:22:09.471 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-01T15:22:09.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:22:09.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.667+0000 7f40fd600640 1 Processor -- start 2024-04-01T15:22:09.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.667+0000 7f40fd600640 1 -- start start 2024-04-01T15:22:09.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.668+0000 7f40fd600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40f80b5be0 0x7f40f80af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.668+0000 7f40fd600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f40f80af080 0x7f40f80add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.668+0000 7f40fd600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40f80b5fc0 con 0x7f40f80afbe0 2024-04-01T15:22:09.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.668+0000 7f40fd600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f40f80b5610 con 0x7f40f80b5be0 2024-04-01T15:22:09.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.668+0000 7f40fd600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f40f80b1230 con 0x7f40f80af080 2024-04-01T15:22:09.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.668+0000 7f40fcc00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f40f80afbe0 0x7f40f80ae280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44374/0 (socket says 172.21.15.142:44374) 2024-04-01T15:22:09.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.668+0000 7f40fcc00640 1 -- 172.21.15.142:0/2295460465 learned_addr learned my addr 172.21.15.142:0/2295460465 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:09.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.668+0000 7f40f7e00640 1 --2- 172.21.15.142:0/2295460465 >> v2:172.21.15.142:3300/0 conn(0x7f40f80b5be0 0x7f40f80af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.669+0000 7f40f7400640 1 --2- 172.21.15.142:0/2295460465 >> v2:172.21.15.179:3300/0 conn(0x7f40f80af080 0x7f40f80add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.669+0000 7f40f6a00640 1 -- 172.21.15.142:0/2295460465 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480660766 0 0) 0x7f40f80b5fc0 con 0x7f40f80afbe0 2024-04-01T15:22:09.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.669+0000 7f40f6a00640 1 -- 172.21.15.142:0/2295460465 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40dc003520 con 0x7f40f80afbe0 2024-04-01T15:22:09.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.669+0000 7f40f7e00640 1 -- 172.21.15.142:0/2295460465 >> v2:172.21.15.179:3300/0 conn(0x7f40f80af080 msgr2=0x7f40f80add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:09.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.669+0000 7f40f7e00640 1 --2- 172.21.15.142:0/2295460465 >> v2:172.21.15.179:3300/0 conn(0x7f40f80af080 0x7f40f80add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.669+0000 7f40f7e00640 1 -- 172.21.15.142:0/2295460465 >> v1:172.21.15.142:6789/0 conn(0x7f40f80afbe0 legacy=0x7f40f80ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.669+0000 7f40f7e00640 1 -- 172.21.15.142:0/2295460465 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f80b1510 con 0x7f40f80b5be0 2024-04-01T15:22:09.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.670+0000 7f40f7e00640 1 --2- 172.21.15.142:0/2295460465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80b5be0 0x7f40f80af6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f40f806df30 tx=0x7f40e802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5890703d83314bb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:09.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.670+0000 7f40f6a00640 1 -- 172.21.15.142:0/2295460465 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8038070 con 0x7f40f80b5be0 2024-04-01T15:22:09.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.670+0000 7f40f6a00640 1 -- 172.21.15.142:0/2295460465 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e8031700 con 0x7f40f80b5be0 2024-04-01T15:22:09.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.670+0000 7f40f6a00640 1 -- 172.21.15.142:0/2295460465 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8031ab0 con 0x7f40f80b5be0 2024-04-01T15:22:09.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.671+0000 7f40fd600640 1 -- 172.21.15.142:0/2295460465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80b5be0 msgr2=0x7f40f80af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.671+0000 7f40fd600640 1 --2- 172.21.15.142:0/2295460465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80b5be0 0x7f40f80af6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f40f806df30 tx=0x7f40e802b7a0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.671+0000 7f40fd600640 1 -- 172.21.15.142:0/2295460465 shutdown_connections 2024-04-01T15:22:09.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.671+0000 7f40fd600640 1 --2- 172.21.15.142:0/2295460465 >> v2:172.21.15.179:3300/0 conn(0x7f40f80af080 0x7f40f80add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.671+0000 7f40fd600640 1 --2- 172.21.15.142:0/2295460465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80b5be0 0x7f40f80af6a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.671+0000 7f40fd600640 1 -- 172.21.15.142:0/2295460465 >> 172.21.15.142:0/2295460465 conn(0x7f40f806c710 msgr2=0x7f40f806cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:09.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.671+0000 7f40fd600640 1 -- 172.21.15.142:0/2295460465 shutdown_connections 2024-04-01T15:22:09.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.671+0000 7f40fd600640 1 -- 172.21.15.142:0/2295460465 wait complete. 2024-04-01T15:22:09.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.672+0000 7f40fd600640 1 Processor -- start 2024-04-01T15:22:09.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.673+0000 7f40fd600640 1 -- start start 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.673+0000 7f40fd600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80af080 0x7f40f8143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.673+0000 7f40fd600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f80afbe0 0x7f40f813e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.673+0000 7f40fd600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f80b5be0 0x7f40f8141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.673+0000 7f40fd600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f40f80b50f0 con 0x7f40f80af080 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.673+0000 7f40fd600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f40f80b4e10 con 0x7f40f80afbe0 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.673+0000 7f40fd600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f40f80b30c0 con 0x7f40f80b5be0 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.673+0000 7f40f7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80af080 0x7f40f8143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40f7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80af080 0x7f40f8143060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51466/0 (socket says 172.21.15.142:51466) 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40f7e00640 1 -- 172.21.15.142:0/1521822576 learned_addr learned my addr 172.21.15.142:0/1521822576 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40f7400640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f80afbe0 0x7f40f813e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40f7e00640 1 -- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f80b5be0 msgr2=0x7f40f8141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40f7e00640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f80b5be0 0x7f40f8141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40f7e00640 1 -- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f80afbe0 msgr2=0x7f40f813e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40f7e00640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f80afbe0 0x7f40f813e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40f7e00640 1 -- 172.21.15.142:0/1521822576 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f8143780 con 0x7f40f80af080 2024-04-01T15:22:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40f7e00640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80af080 0x7f40f8143060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f40e802b7e0 tx=0x7f40e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40efe00640 1 -- 172.21.15.142:0/1521822576 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8042070 con 0x7f40f80af080 2024-04-01T15:22:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40efe00640 1 -- 172.21.15.142:0/1521822576 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e803d870 con 0x7f40f80af080 2024-04-01T15:22:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40efe00640 1 -- 172.21.15.142:0/1521822576 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8038040 con 0x7f40f80af080 2024-04-01T15:22:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.674+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f8143a60 con 0x7f40f80af080 2024-04-01T15:22:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.675+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f8142290 con 0x7f40f80af080 2024-04-01T15:22:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.676+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f80756d0 con 0x7f40f80af080 2024-04-01T15:22:09.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.676+0000 7f40efe00640 1 -- 172.21.15.142:0/1521822576 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f40e8045070 con 0x7f40f80af080 2024-04-01T15:22:09.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.677+0000 7f40efe00640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f40d806c920 0x7f40d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.677+0000 7f40efe00640 1 -- 172.21.15.142:0/1521822576 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f40e80ad530 con 0x7f40f80af080 2024-04-01T15:22:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.678+0000 7f40f7400640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f40d806c920 0x7f40d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:09.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.679+0000 7f40f7400640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f40d806c920 0x7f40d806ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40f809ec50 tx=0x7f40e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:09.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.682+0000 7f40efe00640 1 -- 172.21.15.142:0/1521822576 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f40f80756d0 con 0x7f40f80af080 2024-04-01T15:22:09.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.866+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40f8068590 con 0x7f40f80af080 2024-04-01T15:22:09.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.869+0000 7f40efe00640 1 -- 172.21.15.142:0/1521822576 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7f40e8030070 con 0x7f40f80af080 2024-04-01T15:22:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":20,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:59.509664+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:22:09.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f40d806c920 msgr2=0x7f40d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f40d806c920 0x7f40d806ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40f809ec50 tx=0x7f40e4008040 comp rx=0 tx=0).stop 2024-04-01T15:22:09.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80af080 msgr2=0x7f40f8143060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:09.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80af080 0x7f40f8143060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f40e802b7e0 tx=0x7f40e80046c0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 shutdown_connections 2024-04-01T15:22:09.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f40d806c920 0x7f40d806ede0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f80b5be0 0x7f40f8141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f80afbe0 0x7f40f813e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 --2- 172.21.15.142:0/1521822576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f80af080 0x7f40f8143060 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:09.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.871+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 >> 172.21.15.142:0/1521822576 conn(0x7f40f806c710 msgr2=0x7f40f80ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:09.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.872+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 shutdown_connections 2024-04-01T15:22:09.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:09.872+0000 7f40fd600640 1 -- 172.21.15.142:0/1521822576 wait complete. 2024-04-01T15:22:09.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T15:21:46.589606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T15:21:55.889957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T15:21:56.928636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T15:22:09.889 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T15:22:10.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.089+0000 7f0e73200640 1 Processor -- start 2024-04-01T15:22:10.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.089+0000 7f0e73200640 1 -- start start 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e73200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e7414ad80 0x7f0e7414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e73200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 0x7f0e74072df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e73200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e74073330 con 0x7f0e7406d740 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e73200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0e7414b720 con 0x7f0e7414ad80 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e73200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0e7406db20 con 0x7f0e74072960 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e71400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e7414ad80 0x7f0e7414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e71400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e7414ad80 0x7f0e7414b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51474/0 (socket says 172.21.15.142:51474) 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e71400640 1 -- 172.21.15.142:0/1026162441 learned_addr learned my addr 172.21.15.142:0/1026162441 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e72800640 1 --2- 172.21.15.142:0/1026162441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 0x7f0e74072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e71400640 1 -- 172.21.15.142:0/1026162441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 msgr2=0x7f0e74072df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e71400640 1 --2- 172.21.15.142:0/1026162441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 0x7f0e74072df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e71400640 1 -- 172.21.15.142:0/1026162441 >> v1:172.21.15.179:6789/0 conn(0x7f0e7406d740 legacy=0x7f0e740b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.091+0000 7f0e71400640 1 -- 172.21.15.142:0/1026162441 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e740ae670 con 0x7f0e7414ad80 2024-04-01T15:22:10.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.092+0000 7f0e71400640 1 --2- 172.21.15.142:0/1026162441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 0x7f0e7414b1e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e740b6850 tx=0x7f0e6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac11178e7c35871 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:10.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.093+0000 7f0e70a00640 1 -- 172.21.15.142:0/1026162441 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e600315a0 con 0x7f0e7414ad80 2024-04-01T15:22:10.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.093+0000 7f0e70a00640 1 -- 172.21.15.142:0/1026162441 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e60037070 con 0x7f0e7414ad80 2024-04-01T15:22:10.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.093+0000 7f0e70a00640 1 -- 172.21.15.142:0/1026162441 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e60031960 con 0x7f0e7414ad80 2024-04-01T15:22:10.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.093+0000 7f0e73200640 1 -- 172.21.15.142:0/1026162441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 msgr2=0x7f0e7414b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.093+0000 7f0e73200640 1 --2- 172.21.15.142:0/1026162441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 0x7f0e7414b1e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e740b6850 tx=0x7f0e6002b840 comp rx=0 tx=0).stop 2024-04-01T15:22:10.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.093+0000 7f0e73200640 1 -- 172.21.15.142:0/1026162441 shutdown_connections 2024-04-01T15:22:10.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.093+0000 7f0e73200640 1 --2- 172.21.15.142:0/1026162441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 0x7f0e74072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.094+0000 7f0e73200640 1 --2- 172.21.15.142:0/1026162441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 0x7f0e7414b1e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.094+0000 7f0e73200640 1 -- 172.21.15.142:0/1026162441 >> 172.21.15.142:0/1026162441 conn(0x7f0e740b5790 msgr2=0x7f0e740b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:10.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.094+0000 7f0e73200640 1 -- 172.21.15.142:0/1026162441 shutdown_connections 2024-04-01T15:22:10.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.094+0000 7f0e73200640 1 -- 172.21.15.142:0/1026162441 wait complete. 2024-04-01T15:22:10.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.095+0000 7f0e73200640 1 Processor -- start 2024-04-01T15:22:10.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.095+0000 7f0e73200640 1 -- start start 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.096+0000 7f0e73200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7406d740 0x7f0e740b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.096+0000 7f0e73200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 0x7f0e74146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.096+0000 7f0e73200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 0x7f0e74147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.096+0000 7f0e73200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740aefa0 con 0x7f0e7414ad80 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.096+0000 7f0e73200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740aec30 con 0x7f0e7406d740 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.096+0000 7f0e73200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0e740b5420 con 0x7f0e74072960 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.096+0000 7f0e72800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 0x7f0e74147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.096+0000 7f0e72800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 0x7f0e74147220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51480/0 (socket says 172.21.15.142:51480) 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.096+0000 7f0e72800640 1 -- 172.21.15.142:0/1073797051 learned_addr learned my addr 172.21.15.142:0/1073797051 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e71400640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 0x7f0e74146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e71e00640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7406d740 0x7f0e740b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e72800640 1 -- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 msgr2=0x7f0e74146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e72800640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 0x7f0e74146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e72800640 1 -- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7406d740 msgr2=0x7f0e740b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e72800640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7406d740 0x7f0e740b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e72800640 1 -- 172.21.15.142:0/1073797051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e74148070 con 0x7f0e7414ad80 2024-04-01T15:22:10.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e72800640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 0x7f0e74147220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c007e70 tx=0x7f0e6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:10.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e6a000640 1 -- 172.21.15.142:0/1073797051 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c014620 con 0x7f0e7414ad80 2024-04-01T15:22:10.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e6a000640 1 -- 172.21.15.142:0/1073797051 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6c019070 con 0x7f0e7414ad80 2024-04-01T15:22:10.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e6a000640 1 -- 172.21.15.142:0/1073797051 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c014a20 con 0x7f0e7414ad80 2024-04-01T15:22:10.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e741468a0 con 0x7f0e7414ad80 2024-04-01T15:22:10.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.097+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e74148350 con 0x7f0e7414ad80 2024-04-01T15:22:10.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.099+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e7414a0b0 con 0x7f0e7414ad80 2024-04-01T15:22:10.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.099+0000 7f0e6a000640 1 -- 172.21.15.142:0/1073797051 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e6c014bc0 con 0x7f0e7414ad80 2024-04-01T15:22:10.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.101+0000 7f0e6a000640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0e5406c920 0x7f0e5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.101+0000 7f0e6a000640 1 -- 172.21.15.142:0/1073797051 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0e6c08c470 con 0x7f0e7414ad80 2024-04-01T15:22:10.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.101+0000 7f0e71e00640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0e5406c920 0x7f0e5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.102+0000 7f0e71e00640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0e5406c920 0x7f0e5406ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0e64004ea0 tx=0x7f0e64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:10.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.105+0000 7f0e6a000640 1 -- 172.21.15.142:0/1073797051 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0e7414a0b0 con 0x7f0e7414ad80 2024-04-01T15:22:10.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.288+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e74068590 con 0x7f0e7414ad80 2024-04-01T15:22:10.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.289+0000 7f0e6a000640 1 -- 172.21.15.142:0/1073797051 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f0e6c011260 con 0x7f0e7414ad80 2024-04-01T15:22:10.290 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2024-04-01T15:22:10.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.291+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0e5406c920 msgr2=0x7f0e5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.291+0000 7f0e73200640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0e5406c920 0x7f0e5406ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0e64004ea0 tx=0x7f0e64009040 comp rx=0 tx=0).stop 2024-04-01T15:22:10.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.291+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 msgr2=0x7f0e74147220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.291+0000 7f0e73200640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 0x7f0e74147220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c007e70 tx=0x7f0e6c00e4b0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.291+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 shutdown_connections 2024-04-01T15:22:10.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.291+0000 7f0e73200640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0e5406c920 0x7f0e5406ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.291+0000 7f0e73200640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7414ad80 0x7f0e74147220 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.292+0000 7f0e73200640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74072960 0x7f0e74146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.292+0000 7f0e73200640 1 --2- 172.21.15.142:0/1073797051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7406d740 0x7f0e740b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.292+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 >> 172.21.15.142:0/1073797051 conn(0x7f0e740b5790 msgr2=0x7f0e7413fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:10.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.292+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 shutdown_connections 2024-04-01T15:22:10.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.292+0000 7f0e73200640 1 -- 172.21.15.142:0/1073797051 wait complete. 2024-04-01T15:22:10.312 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T15:22:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.515+0000 7f9c26e00640 1 Processor -- start 2024-04-01T15:22:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.515+0000 7f9c26e00640 1 -- start start 2024-04-01T15:22:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.516+0000 7f9c26e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c200aefa0 0x7f9c200b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.516+0000 7f9c26e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2006dcb0 con 0x7f9c200b0290 2024-04-01T15:22:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.516+0000 7f9c26e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c200b14b0 con 0x7f9c2006d8d0 2024-04-01T15:22:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.516+0000 7f9c26e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9c200b1790 con 0x7f9c200aefa0 2024-04-01T15:22:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c24e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9c200b0290 0x7f9c200b2160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44378/0 (socket says 172.21.15.142:44378) 2024-04-01T15:22:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c24e00640 1 -- 172.21.15.142:0/1595431079 learned_addr learned my addr 172.21.15.142:0/1595431079 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c17e00640 1 --2- 172.21.15.142:0/1595431079 >> v2:172.21.15.179:3300/0 conn(0x7f9c200aefa0 0x7f9c200b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553111055 0 0) 0x7f9c2006dcb0 con 0x7f9c200b0290 2024-04-01T15:22:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c04003520 con 0x7f9c200b0290 2024-04-01T15:22:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3837896754 0 0) 0x7f9c04003520 con 0x7f9c200b0290 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 >> v2:172.21.15.179:3300/0 conn(0x7f9c200aefa0 msgr2=0x7f9c200b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 --2- 172.21.15.142:0/1595431079 >> v2:172.21.15.179:3300/0 conn(0x7f9c200aefa0 0x7f9c200b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 >> v1:172.21.15.179:6789/0 conn(0x7f9c2006d8d0 legacy=0x7f9c200ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200b53b0 con 0x7f9c200b0290 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f9c180019f0 con 0x7f9c200b0290 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 >> v1:172.21.15.142:6789/0 conn(0x7f9c200b0290 legacy=0x7f9c200b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.517+0000 7f9c1f400640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c040039b0 0x7f9c04003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1f400640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c04004800 0x7f9c04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1f400640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c040051c0 0x7f9c0400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200b1790 con 0x7f9c040039b0 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0400e250 con 0x7f9c04004800 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0400e450 con 0x7f9c040051c0 2024-04-01T15:22:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1fe00640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c040039b0 0x7f9c04003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c17e00640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c04004800 0x7f9c04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c24e00640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c040051c0 0x7f9c0400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1fe00640 1 -- 172.21.15.142:0/1595431079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c040051c0 msgr2=0x7f9c0400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1fe00640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c040051c0 0x7f9c0400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1fe00640 1 -- 172.21.15.142:0/1595431079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c04004800 msgr2=0x7f9c04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1fe00640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c04004800 0x7f9c04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c1fe00640 1 -- 172.21.15.142:0/1595431079 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c04003520 con 0x7f9c040039b0 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.518+0000 7f9c24e00640 1 -- 172.21.15.142:0/1595431079 reap_dead start 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.519+0000 7f9c1fe00640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c040039b0 0x7f9c04003db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9c10003db0 tx=0x7f9c04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae2fe5c4dc7ee01 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10037070 con 0x7f9c040039b0 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1002be50 con 0x7f9c040039b0 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c1f400640 1 -- 172.21.15.142:0/1595431079 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10003980 con 0x7f9c040039b0 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c26e00640 1 -- 172.21.15.142:0/1595431079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c040039b0 msgr2=0x7f9c04003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c26e00640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c040039b0 0x7f9c04003db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9c10003db0 tx=0x7f9c04005830 comp rx=0 tx=0).stop 2024-04-01T15:22:10.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c26e00640 1 -- 172.21.15.142:0/1595431079 shutdown_connections 2024-04-01T15:22:10.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c26e00640 1 --2- 172.21.15.142:0/1595431079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c040039b0 0x7f9c04003db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c26e00640 1 -- 172.21.15.142:0/1595431079 >> 172.21.15.142:0/1595431079 conn(0x7f9c200b5890 msgr2=0x7f9c200b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:10.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c26e00640 1 -- 172.21.15.142:0/1595431079 shutdown_connections 2024-04-01T15:22:10.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.520+0000 7f9c26e00640 1 -- 172.21.15.142:0/1595431079 wait complete. 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.522+0000 7f9c26e00640 1 Processor -- start 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.522+0000 7f9c26e00640 1 -- start start 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c26e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c040039b0 0x7f9c201dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c26e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c20070cb0 0x7f9c201e0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c26e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c201ccba0 0x7f9c201cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c26e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200ae370 con 0x7f9c20070cb0 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c26e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200ae090 con 0x7f9c040039b0 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c26e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9c200ae890 con 0x7f9c201ccba0 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c17e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c20070cb0 0x7f9c201e0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c17e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c20070cb0 0x7f9c201e0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51510/0 (socket says 172.21.15.142:51510) 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c17e00640 1 -- 172.21.15.142:0/3671634186 learned_addr learned my addr 172.21.15.142:0/3671634186 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c17e00640 1 -- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c201ccba0 msgr2=0x7f9c201cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c17e00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c201ccba0 0x7f9c201cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c17e00640 1 -- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c040039b0 msgr2=0x7f9c201dcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c1fe00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c040039b0 0x7f9c201dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c17e00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c040039b0 0x7f9c201dcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.523+0000 7f9c17e00640 1 -- 172.21.15.142:0/3671634186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2009ea70 con 0x7f9c20070cb0 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.524+0000 7f9c17e00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c20070cb0 0x7f9c201e0d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9c080114e0 tx=0x7f9c080119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.524+0000 7f9c1cc00640 1 -- 172.21.15.142:0/3671634186 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08015870 con 0x7f9c20070cb0 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.524+0000 7f9c1cc00640 1 -- 172.21.15.142:0/3671634186 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c08015a10 con 0x7f9c20070cb0 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.524+0000 7f9c1cc00640 1 -- 172.21.15.142:0/3671634186 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08015dc0 con 0x7f9c20070cb0 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.524+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c201a9fc0 con 0x7f9c20070cb0 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.524+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c201e07f0 con 0x7f9c20070cb0 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.525+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c20068710 con 0x7f9c20070cb0 2024-04-01T15:22:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.526+0000 7f9c1cc00640 1 -- 172.21.15.142:0/3671634186 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c08013400 con 0x7f9c20070cb0 2024-04-01T15:22:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.527+0000 7f9c1cc00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9bfc06c8f0 0x7f9bfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.527+0000 7f9c1cc00640 1 -- 172.21.15.142:0/3671634186 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9c0808c3c0 con 0x7f9c20070cb0 2024-04-01T15:22:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.527+0000 7f9c1fe00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9bfc06c8f0 0x7f9bfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.528+0000 7f9c1fe00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9bfc06c8f0 0x7f9bfc06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c10034000 tx=0x7f9c10009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:10.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.531+0000 7f9c1cc00640 1 -- 172.21.15.142:0/3671634186 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9c08019030 con 0x7f9c20070cb0 2024-04-01T15:22:10.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.730+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9c201a9ce0 con 0x7f9c20070cb0 2024-04-01T15:22:10.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.731+0000 7f9c1cc00640 1 -- 172.21.15.142:0/3671634186 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f9c0805a7e0 con 0x7f9c20070cb0 2024-04-01T15:22:10.733 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9bfc06c8f0 msgr2=0x7f9bfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9bfc06c8f0 0x7f9bfc06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c10034000 tx=0x7f9c10009030 comp rx=0 tx=0).stop 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c20070cb0 msgr2=0x7f9c201e0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c20070cb0 0x7f9c201e0d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9c080114e0 tx=0x7f9c080119a0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 shutdown_connections 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f9bfc06c8f0 0x7f9bfc06edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c201ccba0 0x7f9c201cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c20070cb0 0x7f9c201e0d10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 --2- 172.21.15.142:0/3671634186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c040039b0 0x7f9c201dcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 >> 172.21.15.142:0/3671634186 conn(0x7f9c200b5890 msgr2=0x7f9c200b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 shutdown_connections 2024-04-01T15:22:10.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.734+0000 7f9c26e00640 1 -- 172.21.15.142:0/3671634186 wait complete. 2024-04-01T15:22:10.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T15:22:10.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.960+0000 7f7ecca00640 1 Processor -- start 2024-04-01T15:22:10.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.960+0000 7f7ecca00640 1 -- start start 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ecca00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ec80b2d20 0x7f7ec81491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ecca00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ec8149720 0x7f7ec814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ecca00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec80b3180 con 0x7f7ec806d8d0 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ecca00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec80b0b20 con 0x7f7ec8149720 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ecca00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec806dcb0 con 0x7f7ec80b2d20 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ec6800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ec8149720 0x7f7ec814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ec6800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ec8149720 0x7f7ec814fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51522/0 (socket says 172.21.15.142:51522) 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ec6800640 1 -- 172.21.15.142:0/2461071624 learned_addr learned my addr 172.21.15.142:0/2461071624 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ebd400640 1 --2- 172.21.15.142:0/2461071624 >> v2:172.21.15.179:3300/0 conn(0x7f7ec80b2d20 0x7f7ec81491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ec6800640 1 -- 172.21.15.142:0/2461071624 >> v2:172.21.15.179:3300/0 conn(0x7f7ec80b2d20 msgr2=0x7f7ec81491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ec6800640 1 --2- 172.21.15.142:0/2461071624 >> v2:172.21.15.179:3300/0 conn(0x7f7ec80b2d20 0x7f7ec81491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ec6800640 1 -- 172.21.15.142:0/2461071624 >> v1:172.21.15.179:6789/0 conn(0x7f7ec806d8d0 legacy=0x7f7ec80b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:10.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.962+0000 7f7ec6800640 1 -- 172.21.15.142:0/2461071624 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec8148ad0 con 0x7f7ec8149720 2024-04-01T15:22:10.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.963+0000 7f7ec6800640 1 --2- 172.21.15.142:0/2461071624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec8149720 0x7f7ec814fe60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80b0ca0 tx=0x7f7ec002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f3c390eb8b2910 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:10.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.964+0000 7f7ec5400640 1 -- 172.21.15.142:0/2461071624 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec002c9e0 con 0x7f7ec8149720 2024-04-01T15:22:10.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.964+0000 7f7ec5400640 1 -- 172.21.15.142:0/2461071624 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec002cb80 con 0x7f7ec8149720 2024-04-01T15:22:10.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.964+0000 7f7ec5400640 1 -- 172.21.15.142:0/2461071624 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00343f0 con 0x7f7ec8149720 2024-04-01T15:22:10.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.964+0000 7f7ecca00640 1 -- 172.21.15.142:0/2461071624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec8149720 msgr2=0x7f7ec814fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.964+0000 7f7ecca00640 1 --2- 172.21.15.142:0/2461071624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec8149720 0x7f7ec814fe60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80b0ca0 tx=0x7f7ec002be40 comp rx=0 tx=0).stop 2024-04-01T15:22:10.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.965+0000 7f7ecca00640 1 -- 172.21.15.142:0/2461071624 shutdown_connections 2024-04-01T15:22:10.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.965+0000 7f7ecca00640 1 --2- 172.21.15.142:0/2461071624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec8149720 0x7f7ec814fe60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.965+0000 7f7ecca00640 1 --2- 172.21.15.142:0/2461071624 >> v2:172.21.15.179:3300/0 conn(0x7f7ec80b2d20 0x7f7ec81491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.965+0000 7f7ecca00640 1 -- 172.21.15.142:0/2461071624 >> 172.21.15.142:0/2461071624 conn(0x7f7ec80b5890 msgr2=0x7f7ec80b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:10.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.965+0000 7f7ecca00640 1 -- 172.21.15.142:0/2461071624 shutdown_connections 2024-04-01T15:22:10.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.965+0000 7f7ecca00640 1 -- 172.21.15.142:0/2461071624 wait complete. 2024-04-01T15:22:10.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.966+0000 7f7ecca00640 1 Processor -- start 2024-04-01T15:22:10.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.966+0000 7f7ecca00640 1 -- start start 2024-04-01T15:22:10.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ecca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec806d8d0 0x7f7ec8146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ecca00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80b2d20 0x7f7ec81479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ecca00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8149720 0x7f7ec8139600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ecca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec80b16c0 con 0x7f7ec806d8d0 2024-04-01T15:22:10.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ecca00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec80b5510 con 0x7f7ec80b2d20 2024-04-01T15:22:10.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ecca00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec80b4e50 con 0x7f7ec8149720 2024-04-01T15:22:10.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ec5e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec806d8d0 0x7f7ec8146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ec5e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec806d8d0 0x7f7ec8146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51524/0 (socket says 172.21.15.142:51524) 2024-04-01T15:22:10.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ec5e00640 1 -- 172.21.15.142:0/1855300757 learned_addr learned my addr 172.21.15.142:0/1855300757 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:10.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.967+0000 7f7ebd400640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80b2d20 0x7f7ec81479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ec6800640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8149720 0x7f7ec8139600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ec5e00640 1 -- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8149720 msgr2=0x7f7ec8139600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ec5e00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8149720 0x7f7ec8139600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ec5e00640 1 -- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80b2d20 msgr2=0x7f7ec81479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:10.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ec5e00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80b2d20 0x7f7ec81479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:10.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ec5e00640 1 -- 172.21.15.142:0/1855300757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec813e7f0 con 0x7f7ec806d8d0 2024-04-01T15:22:10.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ec5e00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec806d8d0 0x7f7ec8146c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b3f0 tx=0x7f7eb800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:10.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ebea00640 1 -- 172.21.15.142:0/1855300757 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8015020 con 0x7f7ec806d8d0 2024-04-01T15:22:10.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ebea00640 1 -- 172.21.15.142:0/1855300757 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb8011830 con 0x7f7ec806d8d0 2024-04-01T15:22:10.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ebea00640 1 -- 172.21.15.142:0/1855300757 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8011c20 con 0x7f7ec806d8d0 2024-04-01T15:22:10.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec80ae370 con 0x7f7ec806d8d0 2024-04-01T15:22:10.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.968+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec8147ee0 con 0x7f7ec806d8d0 2024-04-01T15:22:10.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.969+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec8068710 con 0x7f7ec806d8d0 2024-04-01T15:22:10.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.970+0000 7f7ebea00640 1 -- 172.21.15.142:0/1855300757 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7eb8018020 con 0x7f7ec806d8d0 2024-04-01T15:22:10.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.971+0000 7f7ebea00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7ea406c8f0 0x7f7ea406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:10.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.971+0000 7f7ebea00640 1 -- 172.21.15.142:0/1855300757 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7eb808b6c0 con 0x7f7ec806d8d0 2024-04-01T15:22:10.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.972+0000 7f7ebd400640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7ea406c8f0 0x7f7ea406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:10.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.973+0000 7f7ebd400640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7ea406c8f0 0x7f7ea406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7ec813de90 tx=0x7f7eb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:10.976+0000 7f7ebea00640 1 -- 172.21.15.142:0/1855300757 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7eb801f030 con 0x7f7ec806d8d0 2024-04-01T15:22:11.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.159+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7ec8146480 con 0x7f7ec806d8d0 2024-04-01T15:22:11.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.159+0000 7f7ebea00640 1 -- 172.21.15.142:0/1855300757 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f7eb80172c0 con 0x7f7ec806d8d0 2024-04-01T15:22:11.161 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7ea406c8f0 msgr2=0x7f7ea406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7ea406c8f0 0x7f7ea406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7ec813de90 tx=0x7f7eb0008040 comp rx=0 tx=0).stop 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec806d8d0 msgr2=0x7f7ec8146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec806d8d0 0x7f7ec8146c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b3f0 tx=0x7f7eb800b8b0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 shutdown_connections 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7ea406c8f0 0x7f7ea406edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8149720 0x7f7ec8139600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80b2d20 0x7f7ec81479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 --2- 172.21.15.142:0/1855300757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec806d8d0 0x7f7ec8146c20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 >> 172.21.15.142:0/1855300757 conn(0x7f7ec80b5890 msgr2=0x7f7ec80b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 shutdown_connections 2024-04-01T15:22:11.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.162+0000 7f7ecca00640 1 -- 172.21.15.142:0/1855300757 wait complete. 2024-04-01T15:22:11.181 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T15:22:11.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.384+0000 7f6a5e800640 1 Processor -- start 2024-04-01T15:22:11.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.384+0000 7f6a5e800640 1 -- start start 2024-04-01T15:22:11.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.385+0000 7f6a5e800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a5806d8d0 0x7f6a580b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.385+0000 7f6a5e800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a580b0fb0 0x7f6a581491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.385+0000 7f6a5e800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a58149720 0x7f6a580b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.385+0000 7f6a5e800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6a580b0b20 con 0x7f6a580b0fb0 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.385+0000 7f6a5e800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f6a5806dcb0 con 0x7f6a5806d8d0 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.385+0000 7f6a5e800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6a58148ad0 con 0x7f6a58149720 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a4ea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a580b0fb0 0x7f6a581491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a4ea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a580b0fb0 0x7f6a581491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51530/0 (socket says 172.21.15.142:51530) 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a4ea00640 1 -- 172.21.15.142:0/1249599406 learned_addr learned my addr 172.21.15.142:0/1249599406 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a57400640 1 --2- 172.21.15.142:0/1249599406 >> v2:172.21.15.179:3300/0 conn(0x7f6a5806d8d0 0x7f6a580b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a57e00640 1 --2- 172.21.15.142:0/1249599406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a58149720 0x7f6a580b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a4ea00640 1 -- 172.21.15.142:0/1249599406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a58149720 msgr2=0x7f6a580b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a4ea00640 1 --2- 172.21.15.142:0/1249599406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a58149720 0x7f6a580b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a4ea00640 1 -- 172.21.15.142:0/1249599406 >> v2:172.21.15.179:3300/0 conn(0x7f6a5806d8d0 msgr2=0x7f6a580b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:11.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a4ea00640 1 --2- 172.21.15.142:0/1249599406 >> v2:172.21.15.179:3300/0 conn(0x7f6a5806d8d0 0x7f6a580b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.386+0000 7f6a4ea00640 1 -- 172.21.15.142:0/1249599406 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a580b5230 con 0x7f6a580b0fb0 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.387+0000 7f6a4ea00640 1 --2- 172.21.15.142:0/1249599406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a580b0fb0 0x7f6a581491e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a580b6880 tx=0x7f6a4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86c7761507537a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a56a00640 1 -- 172.21.15.142:0/1249599406 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40035020 con 0x7f6a580b0fb0 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a56a00640 1 -- 172.21.15.142:0/1249599406 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a40031870 con 0x7f6a580b0fb0 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a56a00640 1 -- 172.21.15.142:0/1249599406 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40031c40 con 0x7f6a580b0fb0 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a5e800640 1 -- 172.21.15.142:0/1249599406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a580b0fb0 msgr2=0x7f6a581491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a5e800640 1 --2- 172.21.15.142:0/1249599406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a580b0fb0 0x7f6a581491e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a580b6880 tx=0x7f6a4002b910 comp rx=0 tx=0).stop 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a5e800640 1 -- 172.21.15.142:0/1249599406 shutdown_connections 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a5e800640 1 --2- 172.21.15.142:0/1249599406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a58149720 0x7f6a580b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a5e800640 1 --2- 172.21.15.142:0/1249599406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a580b0fb0 0x7f6a581491e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a5e800640 1 --2- 172.21.15.142:0/1249599406 >> v2:172.21.15.179:3300/0 conn(0x7f6a5806d8d0 0x7f6a580b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a5e800640 1 -- 172.21.15.142:0/1249599406 >> 172.21.15.142:0/1249599406 conn(0x7f6a580b5890 msgr2=0x7f6a580b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:11.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a5e800640 1 -- 172.21.15.142:0/1249599406 shutdown_connections 2024-04-01T15:22:11.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.388+0000 7f6a5e800640 1 -- 172.21.15.142:0/1249599406 wait complete. 2024-04-01T15:22:11.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.390+0000 7f6a5e800640 1 Processor -- start 2024-04-01T15:22:11.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.390+0000 7f6a5e800640 1 -- start start 2024-04-01T15:22:11.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a5e800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5806d8d0 0x7f6a58143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a5e800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a580b0fb0 0x7f6a581e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a5e800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a58149720 0x7f6a58147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a5e800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a580b4fd0 con 0x7f6a5806d8d0 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a5e800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6a580b4e50 con 0x7f6a58149720 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a5e800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5809edc0 con 0x7f6a580b0fb0 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a57400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5806d8d0 0x7f6a58143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a57400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5806d8d0 0x7f6a58143b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51532/0 (socket says 172.21.15.142:51532) 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a57400640 1 -- 172.21.15.142:0/3212882244 learned_addr learned my addr 172.21.15.142:0/3212882244 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a57400640 1 -- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a580b0fb0 msgr2=0x7f6a581e01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.391+0000 7f6a57400640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a580b0fb0 0x7f6a581e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.392+0000 7f6a57400640 1 -- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a58149720 msgr2=0x7f6a58147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.392+0000 7f6a57400640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a58149720 0x7f6a58147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.392+0000 7f6a57400640 1 -- 172.21.15.142:0/3212882244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a581e0730 con 0x7f6a5806d8d0 2024-04-01T15:22:11.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.392+0000 7f6a57400640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5806d8d0 0x7f6a58143b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800d800 tx=0x7f6a4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:11.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.392+0000 7f6a4fe00640 1 -- 172.21.15.142:0/3212882244 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800b6c0 con 0x7f6a5806d8d0 2024-04-01T15:22:11.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.392+0000 7f6a4fe00640 1 -- 172.21.15.142:0/3212882244 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a48019070 con 0x7f6a5806d8d0 2024-04-01T15:22:11.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.392+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a581cfb80 con 0x7f6a5806d8d0 2024-04-01T15:22:11.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.392+0000 7f6a4fe00640 1 -- 172.21.15.142:0/3212882244 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800ba80 con 0x7f6a5806d8d0 2024-04-01T15:22:11.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.392+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a58144610 con 0x7f6a5806d8d0 2024-04-01T15:22:11.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.393+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a58068710 con 0x7f6a5806d8d0 2024-04-01T15:22:11.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.394+0000 7f6a4fe00640 1 -- 172.21.15.142:0/3212882244 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a4800bc20 con 0x7f6a5806d8d0 2024-04-01T15:22:11.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.395+0000 7f6a4fe00640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6a3406c8f0 0x7f6a3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.395+0000 7f6a4fe00640 1 -- 172.21.15.142:0/3212882244 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a4808bff0 con 0x7f6a5806d8d0 2024-04-01T15:22:11.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.395+0000 7f6a4ea00640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6a3406c8f0 0x7f6a3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.396+0000 7f6a4ea00640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6a3406c8f0 0x7f6a3406edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a40036000 tx=0x7f6a40030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:11.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.399+0000 7f6a4fe00640 1 -- 172.21.15.142:0/3212882244 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6a4801c360 con 0x7f6a5806d8d0 2024-04-01T15:22:11.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.640+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a5806bf80 con 0x7f6a5806d8d0 2024-04-01T15:22:11.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.642+0000 7f6a4fe00640 1 -- 172.21.15.142:0/3212882244 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3533 (secure 0 0 0) 0x7f6a4805a470 con 0x7f6a5806d8d0 2024-04-01T15:22:11.643 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:11.643 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1407766362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1407766362},{"type":"v1","addr":"172.21.15.142:6833","nonce":1407766362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T15:21:57.963541+0000","modified":"2024-04-01T15:22:01.028534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1191595510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1191595510},{"type":"v1","addr":"172.21.15.179:6835","nonce":1191595510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T15:22:11.643 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2024-04-01T15:22:11.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.644+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6a3406c8f0 msgr2=0x7f6a3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.644+0000 7f6a5e800640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6a3406c8f0 0x7f6a3406edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a40036000 tx=0x7f6a40030000 comp rx=0 tx=0).stop 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.644+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5806d8d0 msgr2=0x7f6a58143b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.644+0000 7f6a5e800640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5806d8d0 0x7f6a58143b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800d800 tx=0x7f6a4800dcc0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.645+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 shutdown_connections 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.645+0000 7f6a5e800640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6a3406c8f0 0x7f6a3406edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.645+0000 7f6a5e800640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a58149720 0x7f6a58147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.645+0000 7f6a5e800640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a580b0fb0 0x7f6a581e01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.645+0000 7f6a5e800640 1 --2- 172.21.15.142:0/3212882244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5806d8d0 0x7f6a58143b70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.645+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 >> 172.21.15.142:0/3212882244 conn(0x7f6a580b5890 msgr2=0x7f6a580b7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.645+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 shutdown_connections 2024-04-01T15:22:11.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.645+0000 7f6a5e800640 1 -- 172.21.15.142:0/3212882244 wait complete. 2024-04-01T15:22:11.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:22:11.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.866+0000 7fb54f800640 1 Processor -- start 2024-04-01T15:22:11.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.866+0000 7fb54f800640 1 -- start start 2024-04-01T15:22:11.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.867+0000 7fb54f800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb54806d8d0 0x7fb5480ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.867+0000 7fb54f800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5480aedd0 0x7fb5481482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.867+0000 7fb54f800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5480af240 con 0x7fb5480b0290 2024-04-01T15:22:11.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.867+0000 7fb54f800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb5480b1790 con 0x7fb5480aedd0 2024-04-01T15:22:11.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.867+0000 7fb54f800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fb54806dcb0 con 0x7fb54806d8d0 2024-04-01T15:22:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.868+0000 7fb54d800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5480aedd0 0x7fb5481482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.868+0000 7fb547e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb5480b0290 0x7fb548147be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44386/0 (socket says 172.21.15.142:44386) 2024-04-01T15:22:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.868+0000 7fb547e00640 1 -- 172.21.15.142:0/1688283074 learned_addr learned my addr 172.21.15.142:0/1688283074 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.868+0000 7fb54ce00640 1 --2- 172.21.15.142:0/1688283074 >> v2:172.21.15.179:3300/0 conn(0x7fb54806d8d0 0x7fb5480ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.868+0000 7fb54d800640 1 -- 172.21.15.142:0/1688283074 >> v2:172.21.15.179:3300/0 conn(0x7fb54806d8d0 msgr2=0x7fb5480ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.868+0000 7fb54d800640 1 --2- 172.21.15.142:0/1688283074 >> v2:172.21.15.179:3300/0 conn(0x7fb54806d8d0 0x7fb5480ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.868+0000 7fb54d800640 1 -- 172.21.15.142:0/1688283074 >> v1:172.21.15.142:6789/0 conn(0x7fb5480b0290 legacy=0x7fb548147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.868+0000 7fb54d800640 1 -- 172.21.15.142:0/1688283074 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5480b14b0 con 0x7fb5480aedd0 2024-04-01T15:22:11.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.869+0000 7fb54d800640 1 --2- 172.21.15.142:0/1688283074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480aedd0 0x7fb5481482f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb5480b4e40 tx=0x7fb54002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb737d5848c388c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.869+0000 7fb547400640 1 -- 172.21.15.142:0/1688283074 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540039070 con 0x7fb5480aedd0 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb547400640 1 -- 172.21.15.142:0/1688283074 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54002cbd0 con 0x7fb5480aedd0 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb547400640 1 -- 172.21.15.142:0/1688283074 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540034440 con 0x7fb5480aedd0 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb54f800640 1 -- 172.21.15.142:0/1688283074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480aedd0 msgr2=0x7fb5481482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb54f800640 1 --2- 172.21.15.142:0/1688283074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480aedd0 0x7fb5481482f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb5480b4e40 tx=0x7fb54002be20 comp rx=0 tx=0).stop 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb54f800640 1 -- 172.21.15.142:0/1688283074 shutdown_connections 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb54f800640 1 --2- 172.21.15.142:0/1688283074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480aedd0 0x7fb5481482f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb54f800640 1 --2- 172.21.15.142:0/1688283074 >> v2:172.21.15.179:3300/0 conn(0x7fb54806d8d0 0x7fb5480ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb54f800640 1 -- 172.21.15.142:0/1688283074 >> 172.21.15.142:0/1688283074 conn(0x7fb5480b5890 msgr2=0x7fb5480b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb54f800640 1 -- 172.21.15.142:0/1688283074 shutdown_connections 2024-04-01T15:22:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.870+0000 7fb54f800640 1 -- 172.21.15.142:0/1688283074 wait complete. 2024-04-01T15:22:11.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.872+0000 7fb54f800640 1 Processor -- start 2024-04-01T15:22:11.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.872+0000 7fb54f800640 1 -- start start 2024-04-01T15:22:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.872+0000 7fb54f800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54806d8d0 0x7fb5480b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.872+0000 7fb54f800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480aedd0 0x7fb54814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.872+0000 7fb54f800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5480b0290 0x7fb54814b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.872+0000 7fb54f800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb5480ae090 con 0x7fb54806d8d0 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.872+0000 7fb54f800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb5480addb0 con 0x7fb5480b0290 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.872+0000 7fb54f800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb5480ae370 con 0x7fb5480aedd0 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54ce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54806d8d0 0x7fb5480b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54ce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54806d8d0 0x7fb5480b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51550/0 (socket says 172.21.15.142:51550) 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54ce00640 1 -- 172.21.15.142:0/2712963212 learned_addr learned my addr 172.21.15.142:0/2712963212 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54d800640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5480b0290 0x7fb54814b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb547e00640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480aedd0 0x7fb54814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54ce00640 1 -- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480aedd0 msgr2=0x7fb54814d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54ce00640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480aedd0 0x7fb54814d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54ce00640 1 -- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5480b0290 msgr2=0x7fb54814b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54ce00640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5480b0290 0x7fb54814b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54ce00640 1 -- 172.21.15.142:0/2712963212 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54814c3d0 con 0x7fb54806d8d0 2024-04-01T15:22:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54d800640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5480b0290 0x7fb54814b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.873+0000 7fb54ce00640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54806d8d0 0x7fb5480b4420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00d5f0 tx=0x7fb53c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.874+0000 7fb544c00640 1 -- 172.21.15.142:0/2712963212 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0125f0 con 0x7fb54806d8d0 2024-04-01T15:22:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.874+0000 7fb544c00640 1 -- 172.21.15.142:0/2712963212 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53c019070 con 0x7fb54806d8d0 2024-04-01T15:22:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.874+0000 7fb544c00640 1 -- 172.21.15.142:0/2712963212 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0129d0 con 0x7fb54806d8d0 2024-04-01T15:22:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.874+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54814dd90 con 0x7fb54806d8d0 2024-04-01T15:22:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.874+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5481519a0 con 0x7fb54806d8d0 2024-04-01T15:22:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.875+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb548068710 con 0x7fb54806d8d0 2024-04-01T15:22:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.876+0000 7fb544c00640 1 -- 172.21.15.142:0/2712963212 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb53c012b70 con 0x7fb54806d8d0 2024-04-01T15:22:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.877+0000 7fb544c00640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb52806c8f0 0x7fb52806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.877+0000 7fb544c00640 1 -- 172.21.15.142:0/2712963212 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb53c08bf60 con 0x7fb54806d8d0 2024-04-01T15:22:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.877+0000 7fb547e00640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb52806c8f0 0x7fb52806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.878+0000 7fb547e00640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb52806c8f0 0x7fb52806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb548147270 tx=0x7fb534009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:11.881+0000 7fb544c00640 1 -- 172.21.15.142:0/2712963212 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb53c05a380 con 0x7fb54806d8d0 2024-04-01T15:22:12.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.080+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5480b8480 con 0x7fb54806d8d0 2024-04-01T15:22:12.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.082+0000 7fb544c00640 1 -- 172.21.15.142:0/2712963212 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fb53c059c80 con 0x7fb54806d8d0 2024-04-01T15:22:12.084 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:12.084 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":20,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:59.509664+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:22:12.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb52806c8f0 msgr2=0x7fb52806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb52806c8f0 0x7fb52806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb548147270 tx=0x7fb534009040 comp rx=0 tx=0).stop 2024-04-01T15:22:12.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54806d8d0 msgr2=0x7fb5480b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54806d8d0 0x7fb5480b4420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00d5f0 tx=0x7fb53c00dab0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 shutdown_connections 2024-04-01T15:22:12.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fb52806c8f0 0x7fb52806edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5480b0290 0x7fb54814b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480aedd0 0x7fb54814d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 --2- 172.21.15.142:0/2712963212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54806d8d0 0x7fb5480b4420 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00d5f0 tx=0x7fb53c00dab0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 >> 172.21.15.142:0/2712963212 conn(0x7fb5480b5890 msgr2=0x7fb54806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:12.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 shutdown_connections 2024-04-01T15:22:12.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.085+0000 7fb54f800640 1 -- 172.21.15.142:0/2712963212 wait complete. 2024-04-01T15:22:12.105 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T15:21:46.589606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T15:21:55.889957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T15:21:56.928636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T15:22:12.106 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T15:22:12.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.315+0000 7f6214a00640 1 Processor -- start 2024-04-01T15:22:12.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.315+0000 7f6214a00640 1 -- start start 2024-04-01T15:22:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.316+0000 7f6214a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621013f890 0x7f62100b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.316+0000 7f6214a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6210072ff0 con 0x7f62101492e0 2024-04-01T15:22:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.316+0000 7f6214a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62100b4b30 con 0x7f6210072c10 2024-04-01T15:22:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.316+0000 7f6214a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f62100b5180 con 0x7f621013f890 2024-04-01T15:22:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.316+0000 7f620de00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f62101492e0 0x7f621013f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44394/0 (socket says 172.21.15.142:44394) 2024-04-01T15:22:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.316+0000 7f620de00640 1 -- 172.21.15.142:0/1262145118 learned_addr learned my addr 172.21.15.142:0/1262145118 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.316+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693009277 0 0) 0x7f6210072ff0 con 0x7f62101492e0 2024-04-01T15:22:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.316+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f4003520 con 0x7f62101492e0 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.316+0000 7f620f200640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621013f890 0x7f62100b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1849590123 0 0) 0x7f61f4003520 con 0x7f62101492e0 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621013f890 msgr2=0x7f62100b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621013f890 0x7f62100b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 >> v1:172.21.15.179:6789/0 conn(0x7f6210072c10 legacy=0x7f6210148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100b4e10 con 0x7f62101492e0 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f61fc001670 con 0x7f62101492e0 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 >> v1:172.21.15.142:6789/0 conn(0x7f62101492e0 legacy=0x7f621013f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621013f890 0x7f61f40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61f4004010 0x7f61f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f4004d40 0x7f61f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f62100b5180 con 0x7f61f4004d40 2024-04-01T15:22:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f61f400bc00 con 0x7f61f4004010 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f61f400be00 con 0x7f621013f890 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620f200640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f4004d40 0x7f61f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620e800640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621013f890 0x7f61f40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.317+0000 7f620de00640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61f4004010 0x7f61f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.318+0000 7f620f200640 1 -- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621013f890 msgr2=0x7f61f40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.318+0000 7f620f200640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621013f890 0x7f61f40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.318+0000 7f620f200640 1 -- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61f4004010 msgr2=0x7f61f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.318+0000 7f620f200640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61f4004010 0x7f61f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.318+0000 7f620f200640 1 -- 172.21.15.142:0/1262145118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f4003520 con 0x7f61f4004d40 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.319+0000 7f620f200640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f4004d40 0x7f61f40051c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6208007360 tx=0x7f61f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1130c93ef0ab2b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.319+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208039070 con 0x7f61f4004d40 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.319+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620802ccd0 con 0x7f61f4004d40 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.319+0000 7f620d400640 1 -- 172.21.15.142:0/1262145118 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208009be0 con 0x7f61f4004d40 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.319+0000 7f6214a00640 1 -- 172.21.15.142:0/1262145118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f4004d40 msgr2=0x7f61f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.319+0000 7f6214a00640 1 --2- 172.21.15.142:0/1262145118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f4004d40 0x7f61f40051c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6208007360 tx=0x7f61f4005830 comp rx=0 tx=0).stop 2024-04-01T15:22:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.319+0000 7f620f200640 1 -- 172.21.15.142:0/1262145118 reap_dead start 2024-04-01T15:22:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.320+0000 7f6214a00640 1 -- 172.21.15.142:0/1262145118 shutdown_connections 2024-04-01T15:22:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.320+0000 7f6214a00640 1 -- 172.21.15.142:0/1262145118 >> 172.21.15.142:0/1262145118 conn(0x7f621006c810 msgr2=0x7f621006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.320+0000 7f6214a00640 1 -- 172.21.15.142:0/1262145118 shutdown_connections 2024-04-01T15:22:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.320+0000 7f6214a00640 1 -- 172.21.15.142:0/1262145118 wait complete. 2024-04-01T15:22:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.321+0000 7f6214a00640 1 Processor -- start 2024-04-01T15:22:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.321+0000 7f6214a00640 1 -- start start 2024-04-01T15:22:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.322+0000 7f6214a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61f4004d40 0x7f6210148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.322+0000 7f6214a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6210147180 0x7f62100ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.322+0000 7f6214a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f621013bdb0 0x7f621013c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.322+0000 7f6214a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f62100b4860 con 0x7f621013bdb0 2024-04-01T15:22:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.322+0000 7f6214a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f62100b46e0 con 0x7f6210147180 2024-04-01T15:22:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.322+0000 7f6214a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f62100b5f60 con 0x7f61f4004d40 2024-04-01T15:22:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.322+0000 7f620f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f621013bdb0 0x7f621013c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.322+0000 7f620f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f621013bdb0 0x7f621013c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51574/0 (socket says 172.21.15.142:51574) 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.322+0000 7f620f200640 1 -- 172.21.15.142:0/4219383876 learned_addr learned my addr 172.21.15.142:0/4219383876 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f620f200640 1 -- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61f4004d40 msgr2=0x7f6210148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f620e800640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61f4004d40 0x7f6210148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f620f200640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61f4004d40 0x7f6210148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f620f200640 1 -- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6210147180 msgr2=0x7f62100ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f620f200640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6210147180 0x7f62100ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f620f200640 1 -- 172.21.15.142:0/4219383876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100af6c0 con 0x7f621013bdb0 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f620f200640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f621013bdb0 0x7f621013c230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6208002230 tx=0x7f6208004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f6206a00640 1 -- 172.21.15.142:0/4219383876 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208039030 con 0x7f621013bdb0 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f6206a00640 1 -- 172.21.15.142:0/4219383876 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6208043070 con 0x7f621013bdb0 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62101476d0 con 0x7f621013bdb0 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f6206a00640 1 -- 172.21.15.142:0/4219383876 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208009be0 con 0x7f621013bdb0 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.323+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62101467d0 con 0x7f621013bdb0 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.324+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62101465e0 con 0x7f621013bdb0 2024-04-01T15:22:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.325+0000 7f6206a00640 1 -- 172.21.15.142:0/4219383876 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f620803d7d0 con 0x7f621013bdb0 2024-04-01T15:22:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.326+0000 7f6206a00640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f61f006c8f0 0x7f61f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.326+0000 7f6206a00640 1 -- 172.21.15.142:0/4219383876 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f62080aded0 con 0x7f621013bdb0 2024-04-01T15:22:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.327+0000 7f620e800640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f61f006c8f0 0x7f61f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.328+0000 7f620e800640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f61f006c8f0 0x7f61f006edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6200007fd0 tx=0x7f6200009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:12.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.331+0000 7f6206a00640 1 -- 172.21.15.142:0/4219383876 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f620807c2f0 con 0x7f621013bdb0 2024-04-01T15:22:12.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.531+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6210068ca0 con 0x7f621013bdb0 2024-04-01T15:22:12.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.532+0000 7f6206a00640 1 -- 172.21.15.142:0/4219383876 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f620807bbf0 con 0x7f621013bdb0 2024-04-01T15:22:12.533 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2024-04-01T15:22:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.534+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f61f006c8f0 msgr2=0x7f61f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.534+0000 7f6214a00640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f61f006c8f0 0x7f61f006edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6200007fd0 tx=0x7f6200009040 comp rx=0 tx=0).stop 2024-04-01T15:22:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.534+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f621013bdb0 msgr2=0x7f621013c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.534+0000 7f6214a00640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f621013bdb0 0x7f621013c230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6208002230 tx=0x7f6208004ab0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.534+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 shutdown_connections 2024-04-01T15:22:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.534+0000 7f6214a00640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f61f006c8f0 0x7f61f006edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.534+0000 7f6214a00640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f621013bdb0 0x7f621013c230 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.535+0000 7f6214a00640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6210147180 0x7f62100ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.535+0000 7f6214a00640 1 --2- 172.21.15.142:0/4219383876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61f4004d40 0x7f6210148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.535+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 >> 172.21.15.142:0/4219383876 conn(0x7f621006c810 msgr2=0x7f62100b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:12.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.535+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 shutdown_connections 2024-04-01T15:22:12.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.535+0000 7f6214a00640 1 -- 172.21.15.142:0/4219383876 wait complete. 2024-04-01T15:22:12.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T15:22:12.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.755+0000 7f412dc00640 1 Processor -- start 2024-04-01T15:22:12.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.755+0000 7f412dc00640 1 -- start start 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f412dc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41280afae0 0x7f41280b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f412dc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41280b55a0 con 0x7f412814ae90 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f412dc00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41280b0430 con 0x7f41280b51c0 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f412dc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f41280ae8c0 con 0x7f41280afae0 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f4126000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41280afae0 0x7f41280b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f4127400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f412814ae90 0x7f41281521c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44398/0 (socket says 172.21.15.142:44398) 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f4127400640 1 -- 172.21.15.142:0/3166651577 learned_addr learned my addr 172.21.15.142:0/3166651577 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f4126000640 1 -- 172.21.15.142:0/3166651577 >> v1:172.21.15.179:6789/0 conn(0x7f41280b51c0 legacy=0x7f41280b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f4126000640 1 -- 172.21.15.142:0/3166651577 >> v1:172.21.15.142:6789/0 conn(0x7f412814ae90 legacy=0x7f41281521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f4126000640 1 -- 172.21.15.142:0/3166651577 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412806db20 con 0x7f41280afae0 2024-04-01T15:22:12.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.757+0000 7f4125600640 1 -- 172.21.15.142:0/3166651577 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058882724 0 0) 0x7f41280b55a0 con 0x7f412814ae90 2024-04-01T15:22:12.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.759+0000 7f4126000640 1 --2- 172.21.15.142:0/3166651577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41280afae0 0x7f41280b22a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f41180097d0 tx=0x7f411802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46545a48fe96c2d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:12.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.759+0000 7f4125600640 1 -- 172.21.15.142:0/3166651577 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118038070 con 0x7f41280afae0 2024-04-01T15:22:12.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.759+0000 7f4125600640 1 -- 172.21.15.142:0/3166651577 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4118031700 con 0x7f41280afae0 2024-04-01T15:22:12.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.759+0000 7f4125600640 1 -- 172.21.15.142:0/3166651577 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118031ad0 con 0x7f41280afae0 2024-04-01T15:22:12.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.759+0000 7f412dc00640 1 -- 172.21.15.142:0/3166651577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41280afae0 msgr2=0x7f41280b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.759+0000 7f412dc00640 1 --2- 172.21.15.142:0/3166651577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41280afae0 0x7f41280b22a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f41180097d0 tx=0x7f411802b7a0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.760+0000 7f412dc00640 1 -- 172.21.15.142:0/3166651577 shutdown_connections 2024-04-01T15:22:12.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.760+0000 7f412dc00640 1 --2- 172.21.15.142:0/3166651577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41280afae0 0x7f41280b22a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.760+0000 7f412dc00640 1 -- 172.21.15.142:0/3166651577 >> 172.21.15.142:0/3166651577 conn(0x7f41280b5890 msgr2=0x7f41280b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:12.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.760+0000 7f412dc00640 1 -- 172.21.15.142:0/3166651577 shutdown_connections 2024-04-01T15:22:12.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.760+0000 7f412dc00640 1 -- 172.21.15.142:0/3166651577 wait complete. 2024-04-01T15:22:12.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.761+0000 7f412dc00640 1 Processor -- start 2024-04-01T15:22:12.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.761+0000 7f412dc00640 1 -- start start 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.762+0000 7f412dc00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41280b51c0 0x7f41281d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.762+0000 7f412dc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f412814ae90 0x7f412806f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.762+0000 7f412dc00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128072640 0x7f41281d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.762+0000 7f412dc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f41280ae2f0 con 0x7f412814ae90 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.762+0000 7f412dc00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f41280ae170 con 0x7f4128072640 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.762+0000 7f412dc00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f41280aede0 con 0x7f41280b51c0 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.762+0000 7f4126000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f412814ae90 0x7f412806f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.762+0000 7f4126000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f412814ae90 0x7f412806f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51600/0 (socket says 172.21.15.142:51600) 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.762+0000 7f4126000640 1 -- 172.21.15.142:0/1780817607 learned_addr learned my addr 172.21.15.142:0/1780817607 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f4126a00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41280b51c0 0x7f41281d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f4127400640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128072640 0x7f41281d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f4126000640 1 -- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41280b51c0 msgr2=0x7f41281d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f4126000640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41280b51c0 0x7f41281d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f4126000640 1 -- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128072640 msgr2=0x7f41281d1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f4126000640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128072640 0x7f41281d1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f4126000640 1 -- 172.21.15.142:0/1780817607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41281d23f0 con 0x7f412814ae90 2024-04-01T15:22:12.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f4126000640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f412814ae90 0x7f412806f790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f41180098f0 tx=0x7f41180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:12.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f411ea00640 1 -- 172.21.15.142:0/1780817607 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118043070 con 0x7f412814ae90 2024-04-01T15:22:12.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f411ea00640 1 -- 172.21.15.142:0/1780817607 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4118033a30 con 0x7f412814ae90 2024-04-01T15:22:12.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f411ea00640 1 -- 172.21.15.142:0/1780817607 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118038040 con 0x7f412814ae90 2024-04-01T15:22:12.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.763+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41281d2670 con 0x7f412814ae90 2024-04-01T15:22:12.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.764+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4128071e40 con 0x7f412814ae90 2024-04-01T15:22:12.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.765+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4128068710 con 0x7f412814ae90 2024-04-01T15:22:12.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.766+0000 7f411ea00640 1 -- 172.21.15.142:0/1780817607 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4118046070 con 0x7f412814ae90 2024-04-01T15:22:12.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.766+0000 7f411ea00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f410406c8f0 0x7f410406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:12.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.767+0000 7f411ea00640 1 -- 172.21.15.142:0/1780817607 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f41180ad9b0 con 0x7f412814ae90 2024-04-01T15:22:12.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.767+0000 7f4126a00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f410406c8f0 0x7f410406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:12.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.768+0000 7f4126a00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f410406c8f0 0x7f410406edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4110004ea0 tx=0x7f4110009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:12.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.771+0000 7f411ea00640 1 -- 172.21.15.142:0/1780817607 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f41281d23f0 con 0x7f412814ae90 2024-04-01T15:22:12.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.972+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f412806d730 con 0x7f412814ae90 2024-04-01T15:22:12.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.973+0000 7f411ea00640 1 -- 172.21.15.142:0/1780817607 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f4118030070 con 0x7f412814ae90 2024-04-01T15:22:12.974 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f410406c8f0 msgr2=0x7f410406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f410406c8f0 0x7f410406edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4110004ea0 tx=0x7f4110009040 comp rx=0 tx=0).stop 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f412814ae90 msgr2=0x7f412806f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f412814ae90 0x7f412806f790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f41180098f0 tx=0x7f41180046c0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 shutdown_connections 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f410406c8f0 0x7f410406edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128072640 0x7f41281d1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f412814ae90 0x7f412806f790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 --2- 172.21.15.142:0/1780817607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41280b51c0 0x7f41281d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 >> 172.21.15.142:0/1780817607 conn(0x7f41280b5890 msgr2=0x7f412814a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:12.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.975+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 shutdown_connections 2024-04-01T15:22:12.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:12.976+0000 7f412dc00640 1 -- 172.21.15.142:0/1780817607 wait complete. 2024-04-01T15:22:12.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T15:22:13.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.207+0000 7f140f600640 1 Processor -- start 2024-04-01T15:22:13.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.207+0000 7f140f600640 1 -- start start 2024-04-01T15:22:13.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.208+0000 7f140f600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 0x7f14080b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.208+0000 7f140f600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14080b0fb0 0x7f14081491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.208+0000 7f140f600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1408149720 0x7f14080b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.208+0000 7f140f600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f14080b0b20 con 0x7f14080b0fb0 2024-04-01T15:22:13.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.208+0000 7f140f600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f140806dcb0 con 0x7f1408149720 2024-04-01T15:22:13.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.208+0000 7f140f600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1408148ad0 con 0x7f140806d8d0 2024-04-01T15:22:13.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.209+0000 7f1407e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14080b0fb0 0x7f14081491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.209+0000 7f1407e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14080b0fb0 0x7f14081491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51616/0 (socket says 172.21.15.142:51616) 2024-04-01T15:22:13.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.209+0000 7f1407e00640 1 -- 172.21.15.142:0/2345738133 learned_addr learned my addr 172.21.15.142:0/2345738133 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:13.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.209+0000 7f1407e00640 1 -- 172.21.15.142:0/2345738133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 msgr2=0x7f14080b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:13.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.209+0000 7f1407e00640 1 --2- 172.21.15.142:0/2345738133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 0x7f14080b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.209+0000 7f1407e00640 1 -- 172.21.15.142:0/2345738133 >> v2:172.21.15.179:3300/0 conn(0x7f1408149720 msgr2=0x7f14080b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:13.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.209+0000 7f1407e00640 1 --2- 172.21.15.142:0/2345738133 >> v2:172.21.15.179:3300/0 conn(0x7f1408149720 0x7f14080b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.209+0000 7f1407e00640 1 -- 172.21.15.142:0/2345738133 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14080b5230 con 0x7f14080b0fb0 2024-04-01T15:22:13.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.210+0000 7f1407e00640 1 --2- 172.21.15.142:0/2345738133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 0x7f14081491e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f14080b4ba0 tx=0x7f13f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d8dfb8bf2d6520 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:13.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f1407400640 1 -- 172.21.15.142:0/2345738133 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4035020 con 0x7f14080b0fb0 2024-04-01T15:22:13.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f1407400640 1 -- 172.21.15.142:0/2345738133 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f4031870 con 0x7f14080b0fb0 2024-04-01T15:22:13.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f1407400640 1 -- 172.21.15.142:0/2345738133 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4031c40 con 0x7f14080b0fb0 2024-04-01T15:22:13.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f140f600640 1 -- 172.21.15.142:0/2345738133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 msgr2=0x7f14081491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f140f600640 1 --2- 172.21.15.142:0/2345738133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 0x7f14081491e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f14080b4ba0 tx=0x7f13f402b910 comp rx=0 tx=0).stop 2024-04-01T15:22:13.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f140f600640 1 -- 172.21.15.142:0/2345738133 shutdown_connections 2024-04-01T15:22:13.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f140f600640 1 --2- 172.21.15.142:0/2345738133 >> v2:172.21.15.179:3300/0 conn(0x7f1408149720 0x7f14080b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f140f600640 1 --2- 172.21.15.142:0/2345738133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 0x7f14081491e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f140f600640 1 --2- 172.21.15.142:0/2345738133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 0x7f14080b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.211+0000 7f140f600640 1 -- 172.21.15.142:0/2345738133 >> 172.21.15.142:0/2345738133 conn(0x7f14080b5890 msgr2=0x7f14080b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:13.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.212+0000 7f140f600640 1 -- 172.21.15.142:0/2345738133 shutdown_connections 2024-04-01T15:22:13.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.212+0000 7f140f600640 1 -- 172.21.15.142:0/2345738133 wait complete. 2024-04-01T15:22:13.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.213+0000 7f140f600640 1 Processor -- start 2024-04-01T15:22:13.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.213+0000 7f140f600640 1 -- start start 2024-04-01T15:22:13.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.214+0000 7f140f600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 0x7f14080addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.214+0000 7f140f600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 0x7f14081361f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.214+0000 7f140f600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1408149720 0x7f14081e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.214+0000 7f140f600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f14080b4fd0 con 0x7f14080b0fb0 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.214+0000 7f140f600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14080b4e50 con 0x7f1408149720 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.214+0000 7f140f600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f140809edc0 con 0x7f140806d8d0 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.214+0000 7f1407e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 0x7f14081361f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.214+0000 7f1407e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 0x7f14081361f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51622/0 (socket says 172.21.15.142:51622) 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.214+0000 7f1407e00640 1 -- 172.21.15.142:0/2704605466 learned_addr learned my addr 172.21.15.142:0/2704605466 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f140cc00640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 0x7f14080addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f140d600640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1408149720 0x7f14081e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f1407e00640 1 -- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 msgr2=0x7f14080addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f1407e00640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 0x7f14080addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f1407e00640 1 -- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1408149720 msgr2=0x7f14081e0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f1407e00640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1408149720 0x7f14081e0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f1407e00640 1 -- 172.21.15.142:0/2704605466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1408138b10 con 0x7f14080b0fb0 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f140cc00640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 0x7f14080addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:22:13.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f1407e00640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 0x7f14081361f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000c00 tx=0x7f13f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:13.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f1404c00640 1 -- 172.21.15.142:0/2704605466 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f403ad60 con 0x7f14080b0fb0 2024-04-01T15:22:13.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f1404c00640 1 -- 172.21.15.142:0/2704605466 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f40443f0 con 0x7f14080b0fb0 2024-04-01T15:22:13.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.215+0000 7f1404c00640 1 -- 172.21.15.142:0/2704605466 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f40447e0 con 0x7f14080b0fb0 2024-04-01T15:22:13.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.216+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14081374a0 con 0x7f14080b0fb0 2024-04-01T15:22:13.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.216+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1408137ca0 con 0x7f14080b0fb0 2024-04-01T15:22:13.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.217+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1408068710 con 0x7f14080b0fb0 2024-04-01T15:22:13.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.218+0000 7f1404c00640 1 -- 172.21.15.142:0/2704605466 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13f404b060 con 0x7f14080b0fb0 2024-04-01T15:22:13.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.218+0000 7f1404c00640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f13e806c920 0x7f13e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.219+0000 7f1404c00640 1 -- 172.21.15.142:0/2704605466 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f13f40addd0 con 0x7f14080b0fb0 2024-04-01T15:22:13.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.219+0000 7f140cc00640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f13e806c920 0x7f13e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.220+0000 7f140cc00640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f13e806c920 0x7f13e806ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1408138fd0 tx=0x7f13fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:13.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.224+0000 7f1404c00640 1 -- 172.21.15.142:0/2704605466 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f13f403f070 con 0x7f14080b0fb0 2024-04-01T15:22:13.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.423+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f14080b8400 con 0x7f14080b0fb0 2024-04-01T15:22:13.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.424+0000 7f1404c00640 1 -- 172.21.15.142:0/2704605466 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f13f402f320 con 0x7f14080b0fb0 2024-04-01T15:22:13.426 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2024-04-01T15:22:13.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f13e806c920 msgr2=0x7f13e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f13e806c920 0x7f13e806ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1408138fd0 tx=0x7f13fc008040 comp rx=0 tx=0).stop 2024-04-01T15:22:13.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 msgr2=0x7f14081361f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 0x7f14081361f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000c00 tx=0x7f13f40046c0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 shutdown_connections 2024-04-01T15:22:13.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f13e806c920 0x7f13e806ede0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1408149720 0x7f14081e0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14080b0fb0 0x7f14081361f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 --2- 172.21.15.142:0/2704605466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140806d8d0 0x7f14080addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.427+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 >> 172.21.15.142:0/2704605466 conn(0x7f14080b5890 msgr2=0x7f140813e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:13.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.428+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 shutdown_connections 2024-04-01T15:22:13.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.428+0000 7f140f600640 1 -- 172.21.15.142:0/2704605466 wait complete. 2024-04-01T15:22:13.449 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T15:22:13.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.653+0000 7f0275a00640 1 Processor -- start 2024-04-01T15:22:13.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.653+0000 7f0275a00640 1 -- start start 2024-04-01T15:22:13.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.654+0000 7f0275a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f027006d8d0 0x7f02700b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.655+0000 7f0275a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027006dcb0 con 0x7f02700b0fb0 2024-04-01T15:22:13.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.655+0000 7f0275a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0270148ad0 con 0x7f02700b1410 2024-04-01T15:22:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.655+0000 7f0275a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f02700b0b20 con 0x7f027006d8d0 2024-04-01T15:22:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.655+0000 7f026e000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f02700b0fb0 0x7f02701491e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44410/0 (socket says 172.21.15.142:44410) 2024-04-01T15:22:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.655+0000 7f026e000640 1 -- 172.21.15.142:0/2744266301 learned_addr learned my addr 172.21.15.142:0/2744266301 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.655+0000 7f026ea00640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f027006d8d0 0x7f02700b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.655+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 581180678 0 0) 0x7f027006dcb0 con 0x7f02700b0fb0 2024-04-01T15:22:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.655+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0254003520 con 0x7f02700b0fb0 2024-04-01T15:22:13.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2897324636 0 0) 0x7f0254003520 con 0x7f02700b0fb0 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f027006d8d0 msgr2=0x7f02700b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f027006d8d0 0x7f02700b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 >> v1:172.21.15.179:6789/0 conn(0x7f02700b1410 legacy=0x7f027014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02700b5230 con 0x7f02700b0fb0 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f0258001670 con 0x7f02700b0fb0 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 >> v1:172.21.15.142:6789/0 conn(0x7f02700b0fb0 legacy=0x7f02701491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02540039e0 0x7f0254003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0254004800 0x7f0254004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f027006d8d0 0x7f0254005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f02700b0b20 con 0x7f02540039e0 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f025400baf0 con 0x7f0254004800 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f025400bcf0 con 0x7f027006d8d0 2024-04-01T15:22:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026ea00640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02540039e0 0x7f0254003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026e000640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0254004800 0x7f0254004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026ea00640 1 -- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f027006d8d0 msgr2=0x7f0254005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026ea00640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f027006d8d0 0x7f0254005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026ea00640 1 -- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0254004800 msgr2=0x7f0254004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026ea00640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0254004800 0x7f0254004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.656+0000 7f026ea00640 1 -- 172.21.15.142:0/2744266301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0254003520 con 0x7f02540039e0 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.657+0000 7f026ea00640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02540039e0 0x7f0254003e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0260009fc0 tx=0x7f0254005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86af23388de2e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260039070 con 0x7f02540039e0 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026002cc60 con 0x7f02540039e0 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f026d600640 1 -- 172.21.15.142:0/2744266301 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260009c10 con 0x7f02540039e0 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f0275a00640 1 -- 172.21.15.142:0/2744266301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02540039e0 msgr2=0x7f0254003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f0275a00640 1 --2- 172.21.15.142:0/2744266301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02540039e0 0x7f0254003e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0260009fc0 tx=0x7f0254005830 comp rx=0 tx=0).stop 2024-04-01T15:22:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f026f400640 1 -- 172.21.15.142:0/2744266301 reap_dead start 2024-04-01T15:22:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f0275a00640 1 -- 172.21.15.142:0/2744266301 shutdown_connections 2024-04-01T15:22:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f0275a00640 1 -- 172.21.15.142:0/2744266301 >> 172.21.15.142:0/2744266301 conn(0x7f02700b5890 msgr2=0x7f02700b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f0275a00640 1 -- 172.21.15.142:0/2744266301 shutdown_connections 2024-04-01T15:22:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.658+0000 7f0275a00640 1 -- 172.21.15.142:0/2744266301 wait complete. 2024-04-01T15:22:13.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.660+0000 7f0275a00640 1 Processor -- start 2024-04-01T15:22:13.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.660+0000 7f0275a00640 1 -- start start 2024-04-01T15:22:13.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f0275a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540039e0 0x7f02701e0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f0275a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02701e0ca0 0x7f027013bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f0275a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02701e1120 0x7f027013c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f0275a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f02701498f0 con 0x7f02701e1120 2024-04-01T15:22:13.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f0275a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f02700b4e50 con 0x7f02540039e0 2024-04-01T15:22:13.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f0275a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0270148950 con 0x7f02701e0ca0 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f026f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02701e1120 0x7f027013c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f026f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02701e1120 0x7f027013c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51628/0 (socket says 172.21.15.142:51628) 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f026f400640 1 -- 172.21.15.142:0/2672368371 learned_addr learned my addr 172.21.15.142:0/2672368371 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.661+0000 7f026e000640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02701e0ca0 0x7f027013bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f026ea00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540039e0 0x7f02701e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f026f400640 1 -- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02701e0ca0 msgr2=0x7f027013bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f026f400640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02701e0ca0 0x7f027013bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f026f400640 1 -- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540039e0 msgr2=0x7f02701e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f026f400640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540039e0 0x7f02701e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f026f400640 1 -- 172.21.15.142:0/2672368371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02701cfbb0 con 0x7f02701e1120 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f026f400640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02701e1120 0x7f027013c430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0254004780 tx=0x7f026800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f0266a00640 1 -- 172.21.15.142:0/2672368371 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268007340 con 0x7f02701e1120 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f0266a00640 1 -- 172.21.15.142:0/2672368371 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02680074e0 con 0x7f02701e1120 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f0266a00640 1 -- 172.21.15.142:0/2672368371 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268004260 con 0x7f02701e1120 2024-04-01T15:22:13.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02701cf8d0 con 0x7f02701e1120 2024-04-01T15:22:13.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.662+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02701d16a0 con 0x7f02701e1120 2024-04-01T15:22:13.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.664+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0270148740 con 0x7f02701e1120 2024-04-01T15:22:13.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.665+0000 7f0266a00640 1 -- 172.21.15.142:0/2672368371 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0268011070 con 0x7f02701e1120 2024-04-01T15:22:13.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.666+0000 7f0266a00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f024c06c920 0x7f024c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:13.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.666+0000 7f0266a00640 1 -- 172.21.15.142:0/2672368371 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f026808a880 con 0x7f02701e1120 2024-04-01T15:22:13.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.666+0000 7f026ea00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f024c06c920 0x7f024c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:13.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.667+0000 7f026ea00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f024c06c920 0x7f024c06ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0260036000 tx=0x7f026002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:13.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.670+0000 7f0266a00640 1 -- 172.21.15.142:0/2672368371 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f026801a030 con 0x7f02701e1120 2024-04-01T15:22:13.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.906+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0270068710 con 0x7f02701e1120 2024-04-01T15:22:13.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.907+0000 7f0266a00640 1 -- 172.21.15.142:0/2672368371 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3533 (secure 0 0 0) 0x7f0268058cb0 con 0x7f02701e1120 2024-04-01T15:22:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:13.909 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1407766362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1407766362},{"type":"v1","addr":"172.21.15.142:6833","nonce":1407766362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T15:21:57.963541+0000","modified":"2024-04-01T15:22:01.028534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1191595510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1191595510},{"type":"v1","addr":"172.21.15.179:6835","nonce":1191595510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T15:22:13.909 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2024-04-01T15:22:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f024c06c920 msgr2=0x7f024c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f024c06c920 0x7f024c06ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0260036000 tx=0x7f026002e000 comp rx=0 tx=0).stop 2024-04-01T15:22:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02701e1120 msgr2=0x7f027013c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02701e1120 0x7f027013c430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0254004780 tx=0x7f026800c820 comp rx=0 tx=0).stop 2024-04-01T15:22:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 shutdown_connections 2024-04-01T15:22:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f024c06c920 0x7f024c06ede0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02701e1120 0x7f027013c430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02701e0ca0 0x7f027013bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 --2- 172.21.15.142:0/2672368371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540039e0 0x7f02701e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 >> 172.21.15.142:0/2672368371 conn(0x7f02700b5890 msgr2=0x7f027013e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 shutdown_connections 2024-04-01T15:22:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:13.910+0000 7f0275a00640 1 -- 172.21.15.142:0/2672368371 wait complete. 2024-04-01T15:22:13.931 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:22:14.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.130+0000 7feabc800640 1 Processor -- start 2024-04-01T15:22:14.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.130+0000 7feabc800640 1 -- start start 2024-04-01T15:22:14.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feabc800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feab406d8d0 0x7feab40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feabc800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feab40b1410 0x7feab414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feabc800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab406dcb0 con 0x7feab40b0fb0 2024-04-01T15:22:14.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feabc800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7feab40b0b20 con 0x7feab406d8d0 2024-04-01T15:22:14.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feabc800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7feab4148ad0 con 0x7feab40b1410 2024-04-01T15:22:14.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feab9e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feab406d8d0 0x7feab40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feab9400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7feab40b0fb0 0x7feab41491e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44412/0 (socket says 172.21.15.142:44412) 2024-04-01T15:22:14.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feab9400640 1 -- 172.21.15.142:0/1841442557 learned_addr learned my addr 172.21.15.142:0/1841442557 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:14.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feaba800640 1 --2- 172.21.15.142:0/1841442557 >> v2:172.21.15.179:3300/0 conn(0x7feab40b1410 0x7feab414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feab9e00640 1 -- 172.21.15.142:0/1841442557 >> v2:172.21.15.179:3300/0 conn(0x7feab40b1410 msgr2=0x7feab414fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:14.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.131+0000 7feab9e00640 1 --2- 172.21.15.142:0/1841442557 >> v2:172.21.15.179:3300/0 conn(0x7feab40b1410 0x7feab414fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.132+0000 7feab9e00640 1 -- 172.21.15.142:0/1841442557 >> v1:172.21.15.142:6789/0 conn(0x7feab40b0fb0 legacy=0x7feab41491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.132+0000 7feab9e00640 1 -- 172.21.15.142:0/1841442557 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab40b5230 con 0x7feab406d8d0 2024-04-01T15:22:14.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.132+0000 7feaba800640 1 --2- 172.21.15.142:0/1841442557 >> v2:172.21.15.179:3300/0 conn(0x7feab40b1410 0x7feab414fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:14.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.132+0000 7feab8a00640 1 -- 172.21.15.142:0/1841442557 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187728989 0 0) 0x7feab406dcb0 con 0x7feab40b0fb0 2024-04-01T15:22:14.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.133+0000 7feab9e00640 1 --2- 172.21.15.142:0/1841442557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab406d8d0 0x7feab40b2d20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feab40b4ba0 tx=0x7feaa802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75847d32c49cd7d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:14.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.133+0000 7feab8a00640 1 -- 172.21.15.142:0/1841442557 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8035020 con 0x7feab406d8d0 2024-04-01T15:22:14.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.133+0000 7feab8a00640 1 -- 172.21.15.142:0/1841442557 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa8031830 con 0x7feab406d8d0 2024-04-01T15:22:14.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.133+0000 7feab8a00640 1 -- 172.21.15.142:0/1841442557 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8031c00 con 0x7feab406d8d0 2024-04-01T15:22:14.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.134+0000 7feabc800640 1 -- 172.21.15.142:0/1841442557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab406d8d0 msgr2=0x7feab40b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.134+0000 7feabc800640 1 --2- 172.21.15.142:0/1841442557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab406d8d0 0x7feab40b2d20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feab40b4ba0 tx=0x7feaa802b8d0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.134+0000 7feabc800640 1 -- 172.21.15.142:0/1841442557 shutdown_connections 2024-04-01T15:22:14.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.134+0000 7feabc800640 1 --2- 172.21.15.142:0/1841442557 >> v2:172.21.15.179:3300/0 conn(0x7feab40b1410 0x7feab414fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.134+0000 7feabc800640 1 --2- 172.21.15.142:0/1841442557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab406d8d0 0x7feab40b2d20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.134+0000 7feabc800640 1 -- 172.21.15.142:0/1841442557 >> 172.21.15.142:0/1841442557 conn(0x7feab40b5890 msgr2=0x7feab40b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:14.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.134+0000 7feabc800640 1 -- 172.21.15.142:0/1841442557 shutdown_connections 2024-04-01T15:22:14.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.134+0000 7feabc800640 1 -- 172.21.15.142:0/1841442557 wait complete. 2024-04-01T15:22:14.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.135+0000 7feabc800640 1 Processor -- start 2024-04-01T15:22:14.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.135+0000 7feabc800640 1 -- start start 2024-04-01T15:22:14.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.136+0000 7feabc800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab406d8d0 0x7feab413aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.136+0000 7feabc800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40b0fb0 0x7feab413cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.136+0000 7feabc800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab40b1410 0x7feab41dd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.136+0000 7feabc800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feab41498f0 con 0x7feab40b1410 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.136+0000 7feabc800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feab40b4e50 con 0x7feab40b0fb0 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.136+0000 7feabc800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feab41404b0 con 0x7feab406d8d0 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.136+0000 7feaba800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab40b1410 0x7feab41dd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feab9e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab406d8d0 0x7feab413aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feaba800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab40b1410 0x7feab41dd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51644/0 (socket says 172.21.15.142:51644) 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feaba800640 1 -- 172.21.15.142:0/3785501833 learned_addr learned my addr 172.21.15.142:0/3785501833 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feab9400640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40b0fb0 0x7feab413cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feaba800640 1 -- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab406d8d0 msgr2=0x7feab413aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feaba800640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab406d8d0 0x7feab413aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feaba800640 1 -- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40b0fb0 msgr2=0x7feab413cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feaba800640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40b0fb0 0x7feab413cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feaba800640 1 -- 172.21.15.142:0/3785501833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab413fe50 con 0x7feab40b1410 2024-04-01T15:22:14.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feaba800640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab40b1410 0x7feab41dd5e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feab000cf20 tx=0x7feab000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:14.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.137+0000 7feaae000640 1 -- 172.21.15.142:0/3785501833 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab001a070 con 0x7feab40b1410 2024-04-01T15:22:14.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.138+0000 7feaae000640 1 -- 172.21.15.142:0/3785501833 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab000d840 con 0x7feab40b1410 2024-04-01T15:22:14.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.138+0000 7feaae000640 1 -- 172.21.15.142:0/3785501833 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab000dc30 con 0x7feab40b1410 2024-04-01T15:22:14.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.138+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab4140130 con 0x7feab40b1410 2024-04-01T15:22:14.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.138+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab413c090 con 0x7feab40b1410 2024-04-01T15:22:14.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.139+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab413c290 con 0x7feab40b1410 2024-04-01T15:22:14.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.140+0000 7feaae000640 1 -- 172.21.15.142:0/3785501833 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feab001d070 con 0x7feab40b1410 2024-04-01T15:22:14.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.140+0000 7feaae000640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fea9806c8f0 0x7fea9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.140+0000 7feaae000640 1 -- 172.21.15.142:0/3785501833 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feab008c300 con 0x7feab40b1410 2024-04-01T15:22:14.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.141+0000 7feab9e00640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fea9806c8f0 0x7fea9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.142+0000 7feab9e00640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fea9806c8f0 0x7fea9806edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feaa8036000 tx=0x7feaa8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:14.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.145+0000 7feaae000640 1 -- 172.21.15.142:0/3785501833 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7feab413c290 con 0x7feab40b1410 2024-04-01T15:22:14.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.331+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feab4068710 con 0x7feab40b1410 2024-04-01T15:22:14.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.334+0000 7feaae000640 1 -- 172.21.15.142:0/3785501833 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7feab005a0d0 con 0x7feab40b1410 2024-04-01T15:22:14.339 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:14.339 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":20,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:21:59.509664+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fea9806c8f0 msgr2=0x7fea9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fea9806c8f0 0x7fea9806edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feaa8036000 tx=0x7feaa8008030 comp rx=0 tx=0).stop 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab40b1410 msgr2=0x7feab41dd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab40b1410 0x7feab41dd5e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feab000cf20 tx=0x7feab000a7d0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 shutdown_connections 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fea9806c8f0 0x7fea9806edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab40b1410 0x7feab41dd5e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40b0fb0 0x7feab413cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 --2- 172.21.15.142:0/3785501833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab406d8d0 0x7feab413aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 >> 172.21.15.142:0/3785501833 conn(0x7feab40b5890 msgr2=0x7feab40b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:14.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 shutdown_connections 2024-04-01T15:22:14.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.337+0000 7feabc800640 1 -- 172.21.15.142:0/3785501833 wait complete. 2024-04-01T15:22:14.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T15:22:14.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.557+0000 7f1905400640 1 Processor -- start 2024-04-01T15:22:14.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.557+0000 7f1905400640 1 -- start start 2024-04-01T15:22:14.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.558+0000 7f1905400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b51c0 0x7f190014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.558+0000 7f1905400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19000afae0 0x7f19000aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.558+0000 7f1905400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f19000b1b90 0x7f19000b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.558+0000 7f1905400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f19000b55a0 con 0x7f19000b1b90 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.558+0000 7f1905400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f19000b0430 con 0x7f19000afae0 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.558+0000 7f1905400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f19000ae8c0 con 0x7f19000b51c0 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18ff200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f19000b1b90 0x7f19000b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18ff200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f19000b1b90 0x7f19000b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51656/0 (socket says 172.21.15.142:51656) 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18ff200640 1 -- 172.21.15.142:0/1083324718 learned_addr learned my addr 172.21.15.142:0/1083324718 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18fe800640 1 --2- 172.21.15.142:0/1083324718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b51c0 0x7f190014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18fde00640 1 --2- 172.21.15.142:0/1083324718 >> v2:172.21.15.179:3300/0 conn(0x7f19000afae0 0x7f19000aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18ff200640 1 -- 172.21.15.142:0/1083324718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b51c0 msgr2=0x7f190014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18ff200640 1 --2- 172.21.15.142:0/1083324718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b51c0 0x7f190014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18ff200640 1 -- 172.21.15.142:0/1083324718 >> v2:172.21.15.179:3300/0 conn(0x7f19000afae0 msgr2=0x7f19000aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18ff200640 1 --2- 172.21.15.142:0/1083324718 >> v2:172.21.15.179:3300/0 conn(0x7f19000afae0 0x7f19000aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.559+0000 7f18ff200640 1 -- 172.21.15.142:0/1083324718 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190006db20 con 0x7f19000b1b90 2024-04-01T15:22:14.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.560+0000 7f18ff200640 1 --2- 172.21.15.142:0/1083324718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000b1b90 0x7f19000b2000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f190009ef70 tx=0x7f18f802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b6081afac47b99 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.560+0000 7f18fd400640 1 -- 172.21.15.142:0/1083324718 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f802c950 con 0x7f19000b1b90 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.560+0000 7f18fd400640 1 -- 172.21.15.142:0/1083324718 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f802caf0 con 0x7f19000b1b90 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.560+0000 7f18fd400640 1 -- 172.21.15.142:0/1083324718 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80343f0 con 0x7f19000b1b90 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.561+0000 7f1905400640 1 -- 172.21.15.142:0/1083324718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000b1b90 msgr2=0x7f19000b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.561+0000 7f1905400640 1 --2- 172.21.15.142:0/1083324718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000b1b90 0x7f19000b2000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f190009ef70 tx=0x7f18f802bdb0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.561+0000 7f1905400640 1 -- 172.21.15.142:0/1083324718 shutdown_connections 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.561+0000 7f1905400640 1 --2- 172.21.15.142:0/1083324718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000b1b90 0x7f19000b2000 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.561+0000 7f1905400640 1 --2- 172.21.15.142:0/1083324718 >> v2:172.21.15.179:3300/0 conn(0x7f19000afae0 0x7f19000aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.561+0000 7f1905400640 1 --2- 172.21.15.142:0/1083324718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b51c0 0x7f190014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.561+0000 7f1905400640 1 -- 172.21.15.142:0/1083324718 >> 172.21.15.142:0/1083324718 conn(0x7f19000b5890 msgr2=0x7f19000b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.561+0000 7f1905400640 1 -- 172.21.15.142:0/1083324718 shutdown_connections 2024-04-01T15:22:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.561+0000 7f1905400640 1 -- 172.21.15.142:0/1083324718 wait complete. 2024-04-01T15:22:14.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.562+0000 7f1905400640 1 Processor -- start 2024-04-01T15:22:14.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.563+0000 7f1905400640 1 -- start start 2024-04-01T15:22:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.563+0000 7f1905400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b1b90 0x7f190014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.563+0000 7f1905400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19000b51c0 0x7f1900071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.563+0000 7f1905400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1900070dc0 0x7f19001433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.563+0000 7f1905400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f19000adf30 con 0x7f1900070dc0 2024-04-01T15:22:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.563+0000 7f1905400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f19000addb0 con 0x7f19000b51c0 2024-04-01T15:22:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.563+0000 7f1905400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f19000ae170 con 0x7f19000b1b90 2024-04-01T15:22:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18ff200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1900070dc0 0x7f19001433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18ff200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1900070dc0 0x7f19001433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51660/0 (socket says 172.21.15.142:51660) 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18ff200640 1 -- 172.21.15.142:0/2308594035 learned_addr learned my addr 172.21.15.142:0/2308594035 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18fe800640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b1b90 0x7f190014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18fde00640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19000b51c0 0x7f1900071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18ff200640 1 -- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b1b90 msgr2=0x7f190014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18ff200640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b1b90 0x7f190014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18ff200640 1 -- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19000b51c0 msgr2=0x7f1900071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18ff200640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19000b51c0 0x7f1900071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18ff200640 1 -- 172.21.15.142:0/2308594035 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1900143a50 con 0x7f1900070dc0 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18fe800640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b1b90 0x7f190014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.564+0000 7f18ff200640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1900070dc0 0x7f19001433e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009f40 tx=0x7f18f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.565+0000 7f18f6a00640 1 -- 172.21.15.142:0/2308594035 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8043020 con 0x7f1900070dc0 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.565+0000 7f18f6a00640 1 -- 172.21.15.142:0/2308594035 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f803e450 con 0x7f1900070dc0 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.565+0000 7f18f6a00640 1 -- 172.21.15.142:0/2308594035 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f803e840 con 0x7f1900070dc0 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.565+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19000712f0 con 0x7f1900070dc0 2024-04-01T15:22:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.565+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1900142ec0 con 0x7f1900070dc0 2024-04-01T15:22:14.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.566+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1900068710 con 0x7f1900070dc0 2024-04-01T15:22:14.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.567+0000 7f18f6a00640 1 -- 172.21.15.142:0/2308594035 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18f8046020 con 0x7f1900070dc0 2024-04-01T15:22:14.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.568+0000 7f18f6a00640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f18dc06c8f0 0x7f18dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:14.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.568+0000 7f18f6a00640 1 -- 172.21.15.142:0/2308594035 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f18f80ae400 con 0x7f1900070dc0 2024-04-01T15:22:14.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.568+0000 7f18fe800640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f18dc06c8f0 0x7f18dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:14.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.569+0000 7f18fe800640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f18dc06c8f0 0x7f18dc06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006fd0 tx=0x7f18e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:14.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.572+0000 7f18f6a00640 1 -- 172.21.15.142:0/2308594035 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f18f804d030 con 0x7f1900070dc0 2024-04-01T15:22:14.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.812+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19000b7cf0 con 0x7f1900070dc0 2024-04-01T15:22:14.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.813+0000 7f18f6a00640 1 -- 172.21.15.142:0/2308594035 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3533 (secure 0 0 0) 0x7f18f807c820 con 0x7f1900070dc0 2024-04-01T15:22:14.815 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:22:14.815 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1407766362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1407766362},{"type":"v1","addr":"172.21.15.142:6833","nonce":1407766362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T15:21:57.963541+0000","modified":"2024-04-01T15:22:01.028534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1191595510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1191595510},{"type":"v1","addr":"172.21.15.179:6835","nonce":1191595510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T15:22:14.815 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2024-04-01T15:22:14.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f18dc06c8f0 msgr2=0x7f18dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f18dc06c8f0 0x7f18dc06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006fd0 tx=0x7f18e8008040 comp rx=0 tx=0).stop 2024-04-01T15:22:14.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1900070dc0 msgr2=0x7f19001433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:14.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1900070dc0 0x7f19001433e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009f40 tx=0x7f18f8004a40 comp rx=0 tx=0).stop 2024-04-01T15:22:14.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 shutdown_connections 2024-04-01T15:22:14.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f18dc06c8f0 0x7f18dc06edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1900070dc0 0x7f19001433e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19000b51c0 0x7f1900071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 --2- 172.21.15.142:0/2308594035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19000b1b90 0x7f190014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:14.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.816+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 >> 172.21.15.142:0/2308594035 conn(0x7f19000b5890 msgr2=0x7f19000b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:14.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.817+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 shutdown_connections 2024-04-01T15:22:14.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:14.817+0000 7f1905400640 1 -- 172.21.15.142:0/2308594035 wait complete. 2024-04-01T15:22:15.039 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-01T15:21:57.963541+0000', 'modified': '2024-04-01T15:22:01.028534+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/1191595510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 1191595510}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 1191595510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4270, 'qdb_cluster': [4270]} 2024-04-01T15:22:15.039 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-01T15:22:15.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-01T15:22:15.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.247+0000 7faf38000640 1 Processor -- start 2024-04-01T15:22:15.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.247+0000 7faf38000640 1 -- start start 2024-04-01T15:22:15.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.249+0000 7faf38000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf3009f080 0x7faf300b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.249+0000 7faf38000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3009f460 con 0x7faf301416d0 2024-04-01T15:22:15.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.249+0000 7faf38000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf300b4a90 con 0x7faf3014b440 2024-04-01T15:22:15.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.249+0000 7faf38000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faf300b6240 con 0x7faf3009f080 2024-04-01T15:22:15.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.249+0000 7faf34c00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faf301416d0 0x7faf3014ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39994/0 (socket says 172.21.15.142:39994) 2024-04-01T15:22:15.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.249+0000 7faf34c00640 1 -- 172.21.15.142:0/4235669 learned_addr learned my addr 172.21.15.142:0/4235669 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:22:15.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.249+0000 7faf35600640 1 --2- 172.21.15.142:0/4235669 >> v2:172.21.15.142:3300/0 conn(0x7faf3009f080 0x7faf300b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.250+0000 7faf2fe00640 1 -- 172.21.15.142:0/4235669 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1666605337 0 0) 0x7faf3009f460 con 0x7faf301416d0 2024-04-01T15:22:15.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.250+0000 7faf2fe00640 1 -- 172.21.15.142:0/4235669 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf14003520 con 0x7faf301416d0 2024-04-01T15:22:15.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.250+0000 7faf35600640 1 -- 172.21.15.142:0/4235669 >> v1:172.21.15.179:6789/0 conn(0x7faf3014b440 legacy=0x7faf30152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.250+0000 7faf35600640 1 -- 172.21.15.142:0/4235669 >> v1:172.21.15.142:6789/0 conn(0x7faf301416d0 legacy=0x7faf3014ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.250+0000 7faf35600640 1 -- 172.21.15.142:0/4235669 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf300b4d70 con 0x7faf3009f080 2024-04-01T15:22:15.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.251+0000 7faf35600640 1 --2- 172.21.15.142:0/4235669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3009f080 0x7faf300b5b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf200097a0 tx=0x7faf2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46b43b36aa8e095 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:15.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.251+0000 7faf2fe00640 1 -- 172.21.15.142:0/4235669 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20035020 con 0x7faf3009f080 2024-04-01T15:22:15.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.251+0000 7faf2fe00640 1 -- 172.21.15.142:0/4235669 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf20031830 con 0x7faf3009f080 2024-04-01T15:22:15.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.251+0000 7faf2fe00640 1 -- 172.21.15.142:0/4235669 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20031c00 con 0x7faf3009f080 2024-04-01T15:22:15.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.252+0000 7faf38000640 1 -- 172.21.15.142:0/4235669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3009f080 msgr2=0x7faf300b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.252+0000 7faf38000640 1 --2- 172.21.15.142:0/4235669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3009f080 0x7faf300b5b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf200097a0 tx=0x7faf2002b8d0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.252+0000 7faf38000640 1 -- 172.21.15.142:0/4235669 shutdown_connections 2024-04-01T15:22:15.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.252+0000 7faf38000640 1 --2- 172.21.15.142:0/4235669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3009f080 0x7faf300b5b20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.252+0000 7faf38000640 1 -- 172.21.15.142:0/4235669 >> 172.21.15.142:0/4235669 conn(0x7faf300b9ef0 msgr2=0x7faf300ba300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:15.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.252+0000 7faf38000640 1 -- 172.21.15.142:0/4235669 shutdown_connections 2024-04-01T15:22:15.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.252+0000 7faf38000640 1 -- 172.21.15.142:0/4235669 wait complete. 2024-04-01T15:22:15.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.254+0000 7faf38000640 1 Processor -- start 2024-04-01T15:22:15.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.254+0000 7faf38000640 1 -- start start 2024-04-01T15:22:15.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.254+0000 7faf38000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf3009f080 0x7faf30147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.254+0000 7faf38000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf301416d0 0x7faf300b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.254+0000 7faf38000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf30145ca0 0x7faf301e0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.254+0000 7faf38000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faf300b67b0 con 0x7faf30145ca0 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf38000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf300b6630 con 0x7faf301416d0 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf38000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faf30141b50 con 0x7faf3009f080 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf36000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf30145ca0 0x7faf301e0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf36000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf30145ca0 0x7faf301e0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39944/0 (socket says 172.21.15.142:39944) 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf36000640 1 -- 172.21.15.142:0/705292402 learned_addr learned my addr 172.21.15.142:0/705292402 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf34c00640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf301416d0 0x7faf300b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf35600640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf3009f080 0x7faf30147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf36000640 1 -- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf3009f080 msgr2=0x7faf30147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf36000640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf3009f080 0x7faf30147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf36000640 1 -- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf301416d0 msgr2=0x7faf300b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf36000640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf301416d0 0x7faf300b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf36000640 1 -- 172.21.15.142:0/705292402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf30147580 con 0x7faf30145ca0 2024-04-01T15:22:15.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.255+0000 7faf36000640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf30145ca0 0x7faf301e0490 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf2800c6b0 tx=0x7faf2800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:15.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.256+0000 7faf2d600640 1 -- 172.21.15.142:0/705292402 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28003b70 con 0x7faf30145ca0 2024-04-01T15:22:15.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.256+0000 7faf2d600640 1 -- 172.21.15.142:0/705292402 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf28003d30 con 0x7faf30145ca0 2024-04-01T15:22:15.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.256+0000 7faf38000640 1 -- 172.21.15.142:0/705292402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf301dcf20 con 0x7faf30145ca0 2024-04-01T15:22:15.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.256+0000 7faf2d600640 1 -- 172.21.15.142:0/705292402 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28005310 con 0x7faf30145ca0 2024-04-01T15:22:15.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.256+0000 7faf38000640 1 -- 172.21.15.142:0/705292402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf301464a0 con 0x7faf30145ca0 2024-04-01T15:22:15.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.258+0000 7faf2d600640 1 -- 172.21.15.142:0/705292402 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf280054b0 con 0x7faf30145ca0 2024-04-01T15:22:15.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.259+0000 7faf2d600640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7faf1006c8f0 0x7faf1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.259+0000 7faf2d600640 1 -- 172.21.15.142:0/705292402 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faf2808b990 con 0x7faf30145ca0 2024-04-01T15:22:15.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.259+0000 7faf35600640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7faf1006c8f0 0x7faf1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.260+0000 7faf3ac0a740 1 Processor -- start 2024-04-01T15:22:15.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.260+0000 7faf3ac0a740 1 -- start start 2024-04-01T15:22:15.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.260+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e132687aa0 0x55e1326b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.260+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b7500 0x55e1326aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 0x55e1326b0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e13264aab0 con 0x55e132687aa0 2024-04-01T15:22:15.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e1325ecfa0 con 0x55e1326b04a0 2024-04-01T15:22:15.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e132595560 con 0x55e1326b7500 2024-04-01T15:22:15.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7faf1006c8f0 0x7faf1006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faf20036000 tx=0x7faf20008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e132687aa0 0x55e1326b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e132687aa0 0x55e1326b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39960/0 (socket says 172.21.15.142:39960) 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 -- 172.21.15.142:0/2901922411 learned_addr learned my addr 172.21.15.142:0/2901922411 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf34c00640 1 --2- 172.21.15.142:0/2901922411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b7500 0x55e1326aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf36000640 1 --2- 172.21.15.142:0/2901922411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 0x55e1326b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 -- 172.21.15.142:0/2901922411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b7500 msgr2=0x55e1326aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 --2- 172.21.15.142:0/2901922411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b7500 0x55e1326aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 -- 172.21.15.142:0/2901922411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 msgr2=0x55e1326b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 --2- 172.21.15.142:0/2901922411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 0x55e1326b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 -- 172.21.15.142:0/2901922411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1323012d0 con 0x55e132687aa0 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.261+0000 7faf35600640 1 --2- 172.21.15.142:0/2901922411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e132687aa0 0x55e1326b6fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf20009890 tx=0x7faf20030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41fe4c9c34df449 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.262+0000 7faf25c00640 1 -- 172.21.15.142:0/2901922411 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20035040 con 0x55e132687aa0 2024-04-01T15:22:15.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.262+0000 7faf25c00640 1 -- 172.21.15.142:0/2901922411 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf20050630 con 0x55e132687aa0 2024-04-01T15:22:15.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.262+0000 7faf25c00640 1 -- 172.21.15.142:0/2901922411 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20050a20 con 0x55e132687aa0 2024-04-01T15:22:15.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.262+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2901922411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e132687aa0 msgr2=0x55e1326b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.262+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2901922411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e132687aa0 0x55e1326b6fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf20009890 tx=0x7faf20030000 comp rx=0 tx=0).stop 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.262+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2901922411 shutdown_connections 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.262+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2901922411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 0x55e1326b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.262+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2901922411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b7500 0x55e1326aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.263+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2901922411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e132687aa0 0x55e1326b6fc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.263+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2901922411 >> 172.21.15.142:0/2901922411 conn(0x55e132685070 msgr2=0x55e132686ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.263+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2901922411 shutdown_connections 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.263+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2901922411 wait complete. 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.263+0000 7faf3ac0a740 1 -- start start 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.263+0000 7faf3ac0a740 1 Processor -- start 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.264+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 0x55e1326af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.264+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e1326c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.264+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326ad7c0 0x55e1326c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.264+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e1325a8920 con 0x55e1326b7500 2024-04-01T15:22:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.264+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e1325e8f50 con 0x55e1326ad7c0 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.264+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e1326b6830 con 0x55e1326b04a0 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.264+0000 7faf3ac0a740 10 client.0 _ll_register_callbacks cb 0x55e1325a8310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf34c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e1326c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf34c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e1326c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39968/0 (socket says 172.21.15.142:39968) 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf34c00640 1 -- 172.21.15.142:0/2178757033 learned_addr learned my addr 172.21.15.142:0/2178757033 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf35600640 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 0x55e1326af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf36000640 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326ad7c0 0x55e1326c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf34c00640 1 -- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 msgr2=0x55e1326af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf34c00640 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 0x55e1326af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf34c00640 1 -- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326ad7c0 msgr2=0x55e1326c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf34c00640 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326ad7c0 0x55e1326c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf34c00640 1 -- 172.21.15.142:0/2178757033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1323cb6b0 con 0x55e1326b7500 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf35600640 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 0x55e1326af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:15.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf36000640 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326ad7c0 0x55e1326c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf34c00640 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e1326c7ba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000f60 tx=0x7faf1c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1a01243a1c199b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf1a000640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf1a000640 1 -- 172.21.15.142:0/2178757033 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c001c10 con 0x55e1326b7500 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf1a000640 1 -- 172.21.15.142:0/2178757033 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faf1c014400 con 0x55e1326b7500 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.265+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2178757033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf20050630 con 0x55e1326b7500 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf1a000640 1 -- 172.21.15.142:0/2178757033 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7faf1c021050 con 0x55e1326b7500 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf3ac0a740 10 client.4665 fetch_fsmap learned FSMap version 8 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2178757033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55e1326ae9b0 con 0x55e1326b7500 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf1a000640 1 -- 172.21.15.142:0/2178757033 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf20050630 con 0x55e1326b7500 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf1a000640 1 -- 172.21.15.142:0/2178757033 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7faf1c024020 con 0x55e1326b7500 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf3ac0a740 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf3ac0a740 10 client.4665 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf3ac0a740 20 client.4665 populate_metadata read hostname 'smithi142' 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x55e1326cb3f0 0x55e1326d61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf3ac0a740 4 client.4665 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T15:22:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.266+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2178757033 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1325fa4e0 con 0x55e1326cb3f0 2024-04-01T15:22:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.267+0000 7faf35600640 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x55e1326cb3f0 0x55e1326d61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.268+0000 7faf35600640 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x55e1326cb3f0 0x55e1326d61f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7acf2ff785abc22 server_cookie=555417fdb297478c in_seq=0 out_seq=0 2024-04-01T15:22:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.268+0000 7faf1a000640 10 client.4665 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:22:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.269+0000 7faf1a000640 1 -- 172.21.15.142:0/2178757033 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e1325fa4e0 con 0x55e1326cb3f0 2024-04-01T15:22:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.269+0000 7faf1a000640 10 client.4665 handle_command_reply: tid=0 2024-04-01T15:22:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 client.4665 shutdown 2024-04-01T15:22:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2178757033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 msgr2=0x55e1326c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e1326c7ba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000f60 tx=0x7faf1c007800 comp rx=0 tx=0).stop 2024-04-01T15:22:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2178757033 shutdown_connections 2024-04-01T15:22:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x55e1326cb3f0 0x55e1326d61f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326ad7c0 0x55e1326c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e1326c7ba0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/2178757033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 0x55e1326af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf1a000640 0 client.4665 ms_handle_reset on v2:172.21.15.179:6834/1191595510 2024-04-01T15:22:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2178757033 >> 172.21.15.142:0/2178757033 conn(0x55e132687aa0 msgr2=0x55e1326ba3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2178757033 shutdown_connections 2024-04-01T15:22:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 1 -- 172.21.15.142:0/2178757033 wait complete. 2024-04-01T15:22:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.270+0000 7faf3ac0a740 20 client.4665 trim_cache size 0 max 16384 2024-04-01T15:22:15.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.289+0000 7faf3ac0a740 1 Processor -- start 2024-04-01T15:22:15.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf3ac0a740 1 -- start start 2024-04-01T15:22:15.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326ad7c0 0x55e1326c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 0x55e1326db670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b7500 0x55e1326dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faf301e9b00 con 0x55e1326ad7c0 2024-04-01T15:22:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf301e8c30 con 0x55e1326b7500 2024-04-01T15:22:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e1326b3290 con 0x55e1326b04a0 2024-04-01T15:22:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf35600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326ad7c0 0x55e1326c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf35600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326ad7c0 0x55e1326c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39976/0 (socket says 172.21.15.142:39976) 2024-04-01T15:22:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.290+0000 7faf35600640 1 -- 172.21.15.142:0/3469093172 learned_addr learned my addr 172.21.15.142:0/3469093172 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf36000640 1 --2- 172.21.15.142:0/3469093172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b7500 0x55e1326dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf35600640 1 -- 172.21.15.142:0/3469093172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 msgr2=0x55e1326db670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf35600640 1 --2- 172.21.15.142:0/3469093172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 0x55e1326db670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf35600640 1 -- 172.21.15.142:0/3469093172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b7500 msgr2=0x55e1326dbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf35600640 1 --2- 172.21.15.142:0/3469093172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b7500 0x55e1326dbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf35600640 1 -- 172.21.15.142:0/3469093172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1326b5600 con 0x55e1326ad7c0 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf35600640 1 --2- 172.21.15.142:0/3469093172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326ad7c0 0x55e1326c4150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faf20031ce0 tx=0x7faf2003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e85b23c5d08d37 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf25200640 1 -- 172.21.15.142:0/3469093172 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20035070 con 0x55e1326ad7c0 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf25200640 1 -- 172.21.15.142:0/3469093172 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf20004140 con 0x55e1326ad7c0 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.291+0000 7faf25200640 1 -- 172.21.15.142:0/3469093172 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20050610 con 0x55e1326ad7c0 2024-04-01T15:22:15.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.292+0000 7faf3ac0a740 1 -- 172.21.15.142:0/3469093172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326ad7c0 msgr2=0x55e1326c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.292+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/3469093172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326ad7c0 0x55e1326c4150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faf20031ce0 tx=0x7faf2003d040 comp rx=0 tx=0).stop 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.292+0000 7faf3ac0a740 1 -- 172.21.15.142:0/3469093172 shutdown_connections 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.292+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/3469093172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b7500 0x55e1326dbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.292+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/3469093172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326b04a0 0x55e1326db670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.292+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/3469093172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326ad7c0 0x55e1326c4150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.292+0000 7faf3ac0a740 1 -- 172.21.15.142:0/3469093172 >> 172.21.15.142:0/3469093172 conn(0x55e132687aa0 msgr2=0x55e1326adc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.292+0000 7faf3ac0a740 1 -- 172.21.15.142:0/3469093172 shutdown_connections 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.292+0000 7faf3ac0a740 1 -- 172.21.15.142:0/3469093172 wait complete. 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.293+0000 7faf3ac0a740 1 -- start start 2024-04-01T15:22:15.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.293+0000 7faf3ac0a740 1 Processor -- start 2024-04-01T15:22:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.293+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326ad7c0 0x55e13273a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.293+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 0x55e13273d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.293+0000 7faf3ac0a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e13273dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.293+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e1326b4760 con 0x55e1326b7500 2024-04-01T15:22:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.293+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e1326acaf0 con 0x55e1326b04a0 2024-04-01T15:22:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.293+0000 7faf3ac0a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e13273ada0 con 0x55e1326ad7c0 2024-04-01T15:22:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf3ac0a740 10 client.0 _ll_register_callbacks cb 0x7faf1c005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T15:22:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf36000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e13273dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf36000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e13273dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39988/0 (socket says 172.21.15.142:39988) 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf36000640 1 -- 172.21.15.142:0/1330516420 learned_addr learned my addr 172.21.15.142:0/1330516420 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf36000640 1 -- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326ad7c0 msgr2=0x55e13273a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf34c00640 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 0x55e13273d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf35600640 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326ad7c0 0x55e13273a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf36000640 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326ad7c0 0x55e13273a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf36000640 1 -- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 msgr2=0x55e13273d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf36000640 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 0x55e13273d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf36000640 1 -- 172.21.15.142:0/1330516420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1326ce350 con 0x55e1326b7500 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf36000640 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e13273dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf28055b10 tx=0x7faf28059e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe4ecb8bd5135f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.294+0000 7faf1a000640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf1a000640 1 -- 172.21.15.142:0/1330516420 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28062290 con 0x55e1326b7500 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf1a000640 1 -- 172.21.15.142:0/1330516420 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faf28055d20 con 0x55e1326b7500 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf3ac0a740 1 -- 172.21.15.142:0/1330516420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf20004140 con 0x55e1326b7500 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf1a000640 1 -- 172.21.15.142:0/1330516420 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7faf28061e00 con 0x55e1326b7500 2024-04-01T15:22:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf3ac0a740 10 client.4671 fetch_fsmap learned FSMap version 8 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf3ac0a740 1 -- 172.21.15.142:0/1330516420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55e1326875c0 con 0x55e1326b7500 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf1a000640 1 -- 172.21.15.142:0/1330516420 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf20004140 con 0x55e1326b7500 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf1a000640 1 -- 172.21.15.142:0/1330516420 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7faf28058b00 con 0x55e1326b7500 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf3ac0a740 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf3ac0a740 10 client.4671 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf3ac0a740 20 client.4671 populate_metadata read hostname 'smithi142' 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x55e132733d30 0x55e132734110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf3ac0a740 4 client.4671 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.295+0000 7faf3ac0a740 1 -- 172.21.15.142:0/1330516420 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- command(tid 0: {"prefix": "status"}) -- 0x55e1325f4830 con 0x55e132733d30 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.296+0000 7faf35600640 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x55e132733d30 0x55e132734110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.296+0000 7faf35600640 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x55e132733d30 0x55e132734110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c00e0730b1e25ce server_cookie=77520142f45b6901 in_seq=0 out_seq=0 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.296+0000 7faf1a000640 10 client.4671 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf1a000640 1 -- 172.21.15.142:0/1330516420 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55e1325f4830 con 0x55e132733d30 2024-04-01T15:22:15.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf1a000640 10 client.4671 handle_command_reply: tid=0 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf3ac0a740 1 client.4671 shutdown 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf3ac0a740 1 -- 172.21.15.142:0/1330516420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 msgr2=0x55e13273dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e13273dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf28055b10 tx=0x7faf28059e70 comp rx=0 tx=0).stop 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf3ac0a740 1 -- 172.21.15.142:0/1330516420 shutdown_connections 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x55e132733d30 0x55e132734110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e1326b7500 0x55e13273dcd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1326b04a0 0x55e13273d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf3ac0a740 1 --2- 172.21.15.142:0/1330516420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e1326ad7c0 0x55e13273a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf1a000640 0 client.4671 ms_handle_reset on v2:172.21.15.179:6834/1191595510 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.297+0000 7faf3ac0a740 1 -- 172.21.15.142:0/1330516420 >> 172.21.15.142:0/1330516420 conn(0x55e132687aa0 msgr2=0x55e1326c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf3ac0a740 1 -- 172.21.15.142:0/1330516420 shutdown_connections 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf3ac0a740 1 -- 172.21.15.142:0/1330516420 wait complete. 2024-04-01T15:22:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf3ac0a740 20 client.4671 trim_cache size 0 max 16384 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc", 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4270, 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 16.804662066999999, 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 8, 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 20, 2024-04-01T15:22:15.303 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 20, 2024-04-01T15:22:15.304 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 22.343926546999999 2024-04-01T15:22:15.304 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-01T15:22:15.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 -- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7faf1006c8f0 msgr2=0x7faf1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7faf1006c8f0 0x7faf1006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faf20036000 tx=0x7faf20008030 comp rx=0 tx=0).stop 2024-04-01T15:22:15.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 -- 172.21.15.142:0/705292402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf30145ca0 msgr2=0x7faf301e0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:22:15.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf30145ca0 0x7faf301e0490 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf2800c6b0 tx=0x7faf2800cb70 comp rx=0 tx=0).stop 2024-04-01T15:22:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 -- 172.21.15.142:0/705292402 shutdown_connections 2024-04-01T15:22:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7faf1006c8f0 0x7faf1006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf30145ca0 0x7faf301e0490 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf301416d0 0x7faf300b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 --2- 172.21.15.142:0/705292402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf3009f080 0x7faf30147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:22:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.298+0000 7faf38000640 1 -- 172.21.15.142:0/705292402 >> 172.21.15.142:0/705292402 conn(0x7faf300b9ef0 msgr2=0x7faf300ba2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:22:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.299+0000 7faf38000640 1 -- 172.21.15.142:0/705292402 shutdown_connections 2024-04-01T15:22:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:22:15.299+0000 7faf38000640 1 -- 172.21.15.142:0/705292402 wait complete. 2024-04-01T15:22:15.316 INFO:teuthology.run_tasks:Running task sequential... 2024-04-01T15:22:15.326 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-01T15:22:15.326 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-01T15:22:15.327 INFO:teuthology.task.print:Enabling mgr modules 2024-04-01T15:22:15.327 INFO:teuthology.run_tasks:Running task workunit... 2024-04-01T15:22:15.345 INFO:tasks.workunit:Pulling workunits from ref d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T15:22:15.345 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-01T15:22:15.345 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-01T15:22:15.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:22:15.401 INFO:teuthology.orchestra.run.smithi142.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-01T15:22:15.402 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-01T15:22:15.454 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-01T15:22:15.454 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-01T15:22:15.507 INFO:tasks.workunit:timeout=3h 2024-04-01T15:22:15.507 INFO:tasks.workunit:cleanup=True 2024-04-01T15:22:15.507 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T15:22:15.558 INFO:tasks.workunit.client.0.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-01T15:22:20.854 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:22:20.861 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:22:50.990 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:22:50.999 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:23:21.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:23:21.163 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:23:42.536 INFO:tasks.workunit.client.0.smithi142.stderr:Updating files: 64% (7867/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-01T15:23:43.215 INFO:tasks.workunit.client.0.smithi142.stderr:Note: switching to 'd2271579d5e735cfd6d436b8349c004f06527cb0'. 2024-04-01T15:23:43.215 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:43.215 INFO:tasks.workunit.client.0.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-01T15:23:43.215 INFO:tasks.workunit.client.0.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-01T15:23:43.215 INFO:tasks.workunit.client.0.smithi142.stderr:state without impacting any branches by switching back to a branch. 2024-04-01T15:23:43.215 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:43.215 INFO:tasks.workunit.client.0.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-01T15:23:43.215 INFO:tasks.workunit.client.0.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr: git switch -c 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr:Or undo this operation with: 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr: git switch - 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:43.216 INFO:tasks.workunit.client.0.smithi142.stderr:HEAD is now at d2271579d5e Merge PR #53564 into wip-vshankar-testing-20240330.170739 2024-04-01T15:23:43.226 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-01T15:23:43.281 INFO:tasks.workunit.client.0.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-01T15:23:43.288 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T15:23:43.288 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-01T15:23:44.135 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-01T15:23:44.251 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-01T15:23:44.336 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T15:23:44.341 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T15:23:44.342 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-01T15:23:44.421 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T15:23:44.431 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-01T15:23:44.431 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-01T15:23:44.481 INFO:tasks.workunit:Running workunits matching client/test.sh on client.0... 2024-04-01T15:23:44.482 INFO:tasks.workunit:Running workunit client/test.sh... 2024-04-01T15:23:44.482 DEBUG:teuthology.orchestra.run.smithi142:workunit test client/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2271579d5e735cfd6d436b8349c004f06527cb0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh 2024-04-01T15:23:44.549 INFO:tasks.workunit.client.0.smithi142.stderr:+ ceph_test_client 2024-04-01T15:23:44.591 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 26 tests from 1 test suite. 2024-04-01T15:23:44.591 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-04-01T15:23:44.591 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 26 tests from TestClient 2024-04-01T15:23:44.591 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestClient.SingleTargetMdsCommand 2024-04-01T15:23:44.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.590+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.591+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.591+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0348003630 0x564e0d86cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.591+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d86f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.591+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d872220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.591+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564e0d74b040 con 0x564e0d86fd60 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.591+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d6c32b0 con 0x564e0d86d2c0 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.591+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d7ddb90 con 0x7f0348003630 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d872220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d872220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52966/0 (socket says 172.21.15.142:52966) 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363c00640 1 -- 172.21.15.142:0/1302427870 learned_addr learned my addr 172.21.15.142:0/1302427870 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363200640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0348003630 0x564e0d86cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363c00640 1 -- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0348003630 msgr2=0x564e0d86cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f035a800640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d86f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363c00640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0348003630 0x564e0d86cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363c00640 1 -- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 msgr2=0x564e0d86f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363c00640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d86f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363c00640 1 -- 172.21.15.142:0/1302427870 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d872940 con 0x564e0d86fd60 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0363c00640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d872220 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f035c01d000 tx=0x7f0348004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef82aff91bfed05 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.592+0000 7f0361e00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c057040 con 0x564e0d86fd60 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f036683d480 10 client.4677 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f035c054c10 con 0x564e0d86fd60 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d876cf0 con 0x564e0d86fd60 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0358a00640 20 client.4677 tick 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0358a00640 20 client.4677 collect_and_send_metrics 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0358a00640 20 client.4677 collect_and_send_global_metrics 2024-04-01T15:23:44.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0358a00640 5 client.4677 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0358a00640 20 client.4677 trim_cache size 0 max 16384 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0358a00640 20 client.4677 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035c062070 con 0x564e0d86fd60 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f035c0152b0 con 0x564e0d86fd60 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f0361e00640 1 client.4677 handle_mds_map epoch 8 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f036683d480 20 client.4677 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f036683d480 10 client.4677 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f036683d480 20 client.4677 mds is 0 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f036683d480 10 client.4677 _open_mds_session mds.0 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f036683d480 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8776c0 0x564e0d879ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d7da2f0 con 0x564e0d8776c0 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.593+0000 7f036683d480 10 client.4677 waiting for session to mds.0 to open 2024-04-01T15:23:44.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.594+0000 7f0363200640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8776c0 0x564e0d879ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.594+0000 7f0363200640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8776c0 0x564e0d879ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8c5173d03e05d79 server_cookie=9034ff37cdedcda7 in_seq=0 out_seq=0 2024-04-01T15:23:44.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.594+0000 7f0361e00640 10 client.4677 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d7da2f0 con 0x564e0d8776c0 2024-04-01T15:23:44.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f0361e00640 10 client.4677 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f0361e00640 10 client.4677 renew_caps mds.0 2024-04-01T15:23:44.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f034800ac00 con 0x564e0d8776c0 2024-04-01T15:23:44.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f0361e00640 10 client.4677 connect_mds_targets for mds.0 2024-04-01T15:23:44.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f036683d480 10 client.4677 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f036683d480 20 client.4677 mds is 0 2024-04-01T15:23:44.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f036683d480 10 client.4677 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f036683d480 20 client.4677 encode_cap_releases enter (req: 0x564e0d877390, mds: 0) 2024-04-01T15:23:44.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f036683d480 20 client.4677 send_request set sent_stamp to 2024-04-01T15:23:44.601262+0000 2024-04-01T15:23:44.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f036683d480 10 client.4677 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.594566+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.594566+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d87a660 con 0x564e0d8776c0 2024-04-01T15:23:44.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f036683d480 20 client.4677 awaiting reply|forward|kick on 0x7ffc35e46ce0 2024-04-01T15:23:44.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f034800ac00 con 0x564e0d8776c0 2024-04-01T15:23:44.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.600+0000 7f0361e00640 10 client.4677 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f0354006ba0 con 0x564e0d8776c0 2024-04-01T15:23:44.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 insert_trace from 2024-04-01T15:23:44.601262+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 features 0xffffffffffffffff 2024-04-01T15:23:44.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 update_snap_trace len 70 2024-04-01T15:23:44.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 get_snap_realm 0x1 0x7f034800ae20, nref now is 1 2024-04-01T15:23:44.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 15 client.4677 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 15 client.4677 snapc 1=[] 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 put_snap_realm 0x1 0x7f034800ae20 2 -> 1 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f034800af10) - ctime 2024-04-01T15:21:58.495582+0000 mtime 2024-04-01T15:21:58.495582+0000 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 dir hash is 2 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 12 client.4677 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 12 client.4677 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=- has_dir_layout 0x7f034800af10) caps pAsLsXsFs 2024-04-01T15:23:44.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 get_snap_realm 0x1 0x7f034800ae20, nref was 1 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 get_snap_realm 0x1 0x7f034800ae20, nref now is 2 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 15 client.4677 add_update_cap first one, opened snaprealm 0x7f034800ae20 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f034800af10) 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 10 client.4677 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f034800af10) 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 put_snap_realm 0x1 0x7f034800ae20 2 -> 1 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 handle_client_reply signalling caller 0x7ffc35e46ce0 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 handle_client_reply awaiting kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f036683d480 20 client.4677 sendrecv kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f036683d480 20 client.4677 lat 0.001198 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f036683d480 20 client.4677 _ll_get 0x7f034800af10 0x1 -> 1 2024-04-01T15:23:44.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) n = 1 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f035c052640 con 0x564e0d86fd60 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) n = 1 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mon.0 v2:172.21.15.142:3300/0 5 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f035c06a080 con 0x564e0d86fd60 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f036683d480 10 client.4677 fetch_fsmap learned FSMap version 8 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.601+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({fsmap=8}) -- 0x564e0d87aa50 con 0x564e0d86fd60 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.602+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mon.0 v2:172.21.15.142:3300/0 6 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7f035c054070 con 0x564e0d86fd60 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.602+0000 7f036683d480 10 client.4677 fetch_fsmap finished waiting for FSMap version 8 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.602+0000 7f036683d480 10 client.4677 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.602+0000 7f036683d480 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] conn(0x564e0d87dc40 0x564e0d880030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.602+0000 7f036683d480 4 client.4677 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "session ls", "format": "json"}] 2024-04-01T15:23:44.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.602+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 --> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] -- command(tid 0: {"prefix": "session ls", "format": "json"}) -- 0x564e0d6d4840 con 0x564e0d87dc40 2024-04-01T15:23:44.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.602+0000 7f035a800640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] conn(0x564e0d87dc40 0x564e0d880030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.602+0000 7f035a800640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] conn(0x564e0d87dc40 0x564e0d880030 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.? client_cookie=c18781d7c8a025cb server_cookie=9804c30e6133352b in_seq=0 out_seq=0 2024-04-01T15:23:44.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.602+0000 7f0361e00640 10 client.4677 ms_handle_connect on v2:172.21.15.142:6832/1407766362 2024-04-01T15:23:44.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mds.? v2:172.21.15.142:6832/1407766362 1 ==== command_reply(tid 0: -38 ) ==== 8+0+0 (crc 0 0 0) 0x564e0d6d4840 con 0x564e0d87dc40 2024-04-01T15:23:44.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f0361e00640 10 client.4677 handle_command_reply: tid=0 2024-04-01T15:23:44.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 2 client.4677 unmount 2024-04-01T15:23:44.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 2 client.4677 unmounting 2024-04-01T15:23:44.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) n = 1 2024-04-01T15:23:44.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) n = 1 2024-04-01T15:23:44.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 10 client.4677 _ll_drop_pins 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 _ll_put 0x7f034800af10 0x1 1 -> 0 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) n = 1 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) n = 1 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 10 client.4677 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 10 client.4677 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 10 client.4677 nothing to flush 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) n = 1 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) n = 1 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 10 client.4677 flush_caps_sync 2024-04-01T15:23:44.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 10 client.4677 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 trim_cache size 0 max 16384 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 10 client.4677 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) n = 8 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 10 client.4677 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800af10) 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 15 client.4677 remove_cap last one, closing snaprealm 0x7f034800ae20 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 20 client.4677 put_snap_realm 0x1 0x7f034800ae20 1 -> 0 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 10 client.4677 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=- COMPLETE has_dir_layout 0x7f034800af10) 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 2 client.4677 _close_mds_session mds.0 seq 0 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close) -- 0x564e0d7d6d70 con 0x564e0d8776c0 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.603+0000 7f036683d480 2 client.4677 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x564e0d7d6d70 con 0x564e0d8776c0 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 10 client.4677 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 5 client.4677 _closed_mds_session mds.0 seq 0 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 1 -- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8776c0 msgr2=0x564e0d879ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8776c0 0x564e0d879ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 10 client.4677 remove_session_caps mds.0 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 10 client.4677 kick_requests_closed for mds.0 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 10 client.4677 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 20 client.4677 trim_cache size 0 max 16384 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f0361e00640 10 client.4677 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f036683d480 2 client.4677 unmounted. 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.606+0000 7f036683d480 1 client.4677 shutdown 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 msgr2=0x564e0d872220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d872220 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f035c01d000 tx=0x7f0348004120 comp rx=0 tx=0).stop 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 shutdown_connections 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] conn(0x564e0d87dc40 0x564e0d880030 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8776c0 0x564e0d879ab0 unknown :-1 s=CLOSED pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f0363c00640 1 -- 172.21.15.142:0/1302427870 reap_dead start 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d872220 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d86f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 --2- 172.21.15.142:0/1302427870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0348003630 0x564e0d86cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 >> 172.21.15.142:0/1302427870 conn(0x564e0d750560 msgr2=0x564e0d74a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f0361e00640 0 client.4677 ms_handle_reset on v2:172.21.15.142:6832/1407766362 2024-04-01T15:23:44.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 shutdown_connections 2024-04-01T15:23:44.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 1 -- 172.21.15.142:0/1302427870 wait complete. 2024-04-01T15:23:44.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.607+0000 7f036683d480 20 client.4677 trim_cache size 0 max 16384 2024-04-01T15:23:44.618 INFO:tasks.workunit.client.0.smithi142.stdout:SingleTargetMdsCommand: [ OK ] TestClient.SingleTargetMdsCommand (17 ms) 2024-04-01T15:23:44.618 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestClient.MultiTargetMdsCommand 2024-04-01T15:23:44.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.608+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.608+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.608+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86d2c0 0x564e0d872160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.608+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d874a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8776c0 0x564e0d7def50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0348008990 con 0x564e0d86fd60 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f034800beb0 con 0x564e0d8776c0 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0348009b50 con 0x564e0d86d2c0 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d874a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d874a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52968/0 (socket says 172.21.15.142:52968) 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f035a800640 1 -- 172.21.15.142:0/1650698405 learned_addr learned my addr 172.21.15.142:0/1650698405 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f0363200640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86d2c0 0x564e0d872160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f0363c00640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8776c0 0x564e0d7def50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f035a800640 1 -- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86d2c0 msgr2=0x564e0d872160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f035a800640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86d2c0 0x564e0d872160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f035a800640 1 -- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8776c0 msgr2=0x564e0d7def50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f035a800640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8776c0 0x564e0d7def50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.609+0000 7f035a800640 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d74a2f0 con 0x564e0d86fd60 2024-04-01T15:23:44.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f035a800640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d874a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f034c0059d0 tx=0x7f034c00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a3700ba197a41e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0360a00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c009690 con 0x564e0d86fd60 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f034c009830 con 0x564e0d86fd60 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f036683d480 10 client.4680 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d750b80 con 0x564e0d86fd60 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0359400640 20 client.4680 tick 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0359400640 20 client.4680 collect_and_send_metrics 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0359400640 20 client.4680 collect_and_send_global_metrics 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0359400640 5 client.4680 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0359400640 20 client.4680 trim_cache size 0 max 16384 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0359400640 20 client.4680 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034c009a30 con 0x564e0d86fd60 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f034c01a070 con 0x564e0d86fd60 2024-04-01T15:23:44.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f0360a00640 1 client.4680 handle_mds_map epoch 8 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f036683d480 20 client.4680 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f036683d480 10 client.4680 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f036683d480 20 client.4680 mds is 0 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f036683d480 10 client.4680 _open_mds_session mds.0 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f036683d480 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d751b10 con 0x7f0348003630 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.610+0000 7f036683d480 10 client.4680 waiting for session to mds.0 to open 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.611+0000 7f0363200640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.612+0000 7f0363200640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cef30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eea9eedcf25de9d4 server_cookie=c8e781570a1e46b7 in_seq=0 out_seq=0 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.612+0000 7f0360a00640 10 client.4680 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d751b10 con 0x7f0348003630 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f0360a00640 10 client.4680 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f0360a00640 10 client.4680 renew_caps mds.0 2024-04-01T15:23:44.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f034800c0b0 con 0x7f0348003630 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f0360a00640 10 client.4680 connect_mds_targets for mds.0 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f036683d480 10 client.4680 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f036683d480 20 client.4680 mds is 0 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f036683d480 10 client.4680 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f036683d480 20 client.4680 encode_cap_releases enter (req: 0x564e0d7ccba0, mds: 0) 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f036683d480 20 client.4680 send_request set sent_stamp to 2024-04-01T15:23:44.616790+0000 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f036683d480 10 client.4680 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.611783+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.611783+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d7cfaf0 con 0x7f0348003630 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.615+0000 7f036683d480 20 client.4680 awaiting reply|forward|kick on 0x7ffc35e46ce0 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f034800c0b0 con 0x7f0348003630 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f035401e040 con 0x7f0348003630 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 insert_trace from 2024-04-01T15:23:44.616790+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 features 0xffffffffffffffff 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 update_snap_trace len 70 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 get_snap_realm 0x1 0x7f034800c2d0, nref now is 1 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 15 client.4680 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 15 client.4680 snapc 1=[] 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 put_snap_realm 0x1 0x7f034800c2d0 2 -> 1 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f034800c3c0) - ctime 2024-04-01T15:21:58.495582+0000 mtime 2024-04-01T15:21:58.495582+0000 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 dir hash is 2 2024-04-01T15:23:44.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 12 client.4680 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 12 client.4680 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=- has_dir_layout 0x7f034800c3c0) caps pAsLsXsFs 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 get_snap_realm 0x1 0x7f034800c2d0, nref was 1 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 get_snap_realm 0x1 0x7f034800c2d0, nref now is 2 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 15 client.4680 add_update_cap first one, opened snaprealm 0x7f034800c2d0 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f034800c3c0) 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 10 client.4680 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f034800c3c0) 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 put_snap_realm 0x1 0x7f034800c2d0 2 -> 1 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 handle_client_reply signalling caller 0x7ffc35e46ce0 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 handle_client_reply awaiting kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f036683d480 20 client.4680 sendrecv kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f036683d480 20 client.4680 lat 0.000872 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f036683d480 20 client.4680 _ll_get 0x7f034800c3c0 0x1 -> 1 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) n = 1 2024-04-01T15:23:44.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) n = 1 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e0d647bd0 con 0x564e0d86fd60 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mon.0 v2:172.21.15.142:3300/0 5 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f034c025080 con 0x564e0d86fd60 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f036683d480 10 client.4680 fetch_fsmap learned FSMap version 8 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.616+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({fsmap=8}) -- 0x564e0d875500 con 0x564e0d86fd60 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mon.0 v2:172.21.15.142:3300/0 6 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7f034c009be0 con 0x564e0d86fd60 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f036683d480 10 client.4680 fetch_fsmap finished waiting for FSMap version 8 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f036683d480 10 client.4680 resolve_mds: resolving `*' to all MDS daemons 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f036683d480 10 client.4680 resolve_mds: appending daemon mds.a to targets 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f036683d480 10 client.4680 resolve_mds: appending daemon mds.b to targets 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f036683d480 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] conn(0x564e0d87e450 0x564e0d880860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f036683d480 4 client.4680 mds_command: new command op to 4266 tid=0 multi_id=1 [{"prefix": "session ls", "format": "json"}] 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] -- command(tid 0: {"prefix": "session ls", "format": "json"}) -- 0x564e0d698820 con 0x564e0d87e450 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f036683d480 4 client.4680 mds_command: new command op to 4270 tid=1 multi_id=1 [{"prefix": "session ls", "format": "json"}] 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- command(tid 1: {"prefix": "session ls", "format": "json"}) -- 0x564e0d880f40 con 0x7f0348003630 2024-04-01T15:23:44.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.617+0000 7f0363c00640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] conn(0x564e0d87e450 0x564e0d880860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f0360a00640 10 client.4680 ms_handle_connect on v2:172.21.15.142:6832/1407766362 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f0363c00640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] conn(0x564e0d87e450 0x564e0d880860 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.? client_cookie=87a8a4f6032be7ce server_cookie=c94c8083d5e3cf7b in_seq=0 out_seq=0 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== command_reply(tid 1: 0 ) ==== 8+0+1174 (crc 0 0 0) 0x564e0d880f40 con 0x7f0348003630 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f0360a00640 10 client.4680 handle_command_reply: tid=1 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mds.? v2:172.21.15.142:6832/1407766362 1 ==== command_reply(tid 0: -38 ) ==== 8+0+0 (crc 0 0 0) 0x564e0d698820 con 0x564e0d87e450 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f0360a00640 10 client.4680 handle_command_reply: tid=0 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 2 client.4680 unmount 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 2 client.4680 unmounting 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) n = 1 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) n = 1 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 10 client.4680 _ll_drop_pins 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 _ll_put 0x7f034800c3c0 0x1 1 -> 0 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) n = 1 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) n = 1 2024-04-01T15:23:44.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 10 client.4680 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 10 client.4680 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 10 client.4680 nothing to flush 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) n = 1 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) n = 1 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 10 client.4680 flush_caps_sync 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 10 client.4680 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 trim_cache size 0 max 16384 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 10 client.4680 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) n = 8 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 10 client.4680 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800c3c0) 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 15 client.4680 remove_cap last one, closing snaprealm 0x7f034800c2d0 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 20 client.4680 put_snap_realm 0x1 0x7f034800c2d0 1 -> 0 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 10 client.4680 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=- COMPLETE has_dir_layout 0x7f034800c3c0) 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 2 client.4680 _close_mds_session mds.0 seq 0 2024-04-01T15:23:44.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close) -- 0x564e0d7d0110 con 0x7f0348003630 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.618+0000 7f036683d480 2 client.4680 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 <== mds.0 v2:172.21.15.179:6834/1191595510 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x564e0d7d0110 con 0x7f0348003630 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 10 client.4680 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 5 client.4680 _closed_mds_session mds.0 seq 0 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 1 -- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 msgr2=0x564e0d7cef30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cef30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 10 client.4680 remove_session_caps mds.0 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 10 client.4680 kick_requests_closed for mds.0 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 10 client.4680 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 20 client.4680 trim_cache size 0 max 16384 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 10 client.4680 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 2 client.4680 unmounted. 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 client.4680 shutdown 2024-04-01T15:23:44.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 msgr2=0x564e0d874a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d874a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f034c0059d0 tx=0x7f034c00b9f0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 shutdown_connections 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.142:6832/1407766362,v1:172.21.15.142:6833/1407766362] conn(0x564e0d87e450 0x564e0d880860 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cef30 unknown :-1 s=CLOSED pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8776c0 0x564e0d7def50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0360a00640 0 client.4680 ms_handle_reset on v2:172.21.15.142:6832/1407766362 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d874a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 --2- 172.21.15.142:0/1650698405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86d2c0 0x564e0d872160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f0363c00640 1 -- 172.21.15.142:0/1650698405 reap_dead start 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 >> 172.21.15.142:0/1650698405 conn(0x564e0d750560 msgr2=0x564e0d751060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 shutdown_connections 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 1 -- 172.21.15.142:0/1650698405 wait complete. 2024-04-01T15:23:44.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.622+0000 7f036683d480 20 client.4680 trim_cache size 0 max 16384 2024-04-01T15:23:44.637 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestClient.MultiTargetMdsCommand (15 ms) 2024-04-01T15:23:44.637 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestClient.LlreadvLlwritev 2024-04-01T15:23:44.645 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.623+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.645 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.623+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d880850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d86f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d8776c0 0x564e0d748e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f03480053b0 con 0x564e0d86fd60 2024-04-01T15:23:44.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f034800d3a0 con 0x564e0d86d2c0 2024-04-01T15:23:44.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0348007f70 con 0x564e0d8776c0 2024-04-01T15:23:44.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d86f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d86f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52978/0 (socket says 172.21.15.142:52978) 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f035a800640 1 -- 172.21.15.142:0/1290206522 learned_addr learned my addr 172.21.15.142:0/1290206522 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.624+0000 7f0363200640 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d880850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f0363c00640 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d8776c0 0x564e0d748e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f035a800640 1 -- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d8776c0 msgr2=0x564e0d748e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f035a800640 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d8776c0 0x564e0d748e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f035a800640 1 -- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 msgr2=0x564e0d880850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f035a800640 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d880850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f035a800640 1 -- 172.21.15.142:0/1290206522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d875110 con 0x564e0d86fd60 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f035a800640 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d86f6c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f034c000c00 tx=0x7f034c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631118386257560c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f0361e00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c038060 con 0x564e0d86fd60 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f034c00b5b0 con 0x564e0d86fd60 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f036683d480 10 client.4683 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.625+0000 7f036683d480 1 -- 172.21.15.142:0/1290206522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d877070 con 0x564e0d86fd60 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0358a00640 20 client.4683 tick 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0358a00640 20 client.4683 collect_and_send_metrics 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0358a00640 20 client.4683 collect_and_send_global_metrics 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0358a00640 5 client.4683 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0358a00640 20 client.4683 trim_cache size 0 max 16384 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0358a00640 20 client.4683 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564e0d647bd0 con 0x564e0d86fd60 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f034c007af0 con 0x564e0d86fd60 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0361e00640 1 client.4683 handle_mds_map epoch 8 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f036683d480 20 client.4683 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f036683d480 10 client.4683 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f036683d480 20 client.4683 mds is 0 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f036683d480 10 client.4683 _open_mds_session mds.0 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f036683d480 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f036683d480 1 -- 172.21.15.142:0/1290206522 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d7d5c40 con 0x7f0348003630 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f036683d480 10 client.4683 waiting for session to mds.0 to open 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.626+0000 7f0363200640 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.627+0000 7f0363200640 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cea70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dc07617d612342c server_cookie=67b86245d597ab39 in_seq=0 out_seq=0 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.627+0000 7f0361e00640 10 client.4683 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d7d5c40 con 0x7f0348003630 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f0361e00640 10 client.4683 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f0361e00640 10 client.4683 renew_caps mds.0 2024-04-01T15:23:44.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f03480092d0 con 0x7f0348003630 2024-04-01T15:23:44.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f0361e00640 10 client.4683 connect_mds_targets for mds.0 2024-04-01T15:23:44.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f036683d480 10 client.4683 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f036683d480 20 client.4683 mds is 0 2024-04-01T15:23:44.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f036683d480 10 client.4683 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f036683d480 20 client.4683 encode_cap_releases enter (req: 0x564e0d752050, mds: 0) 2024-04-01T15:23:44.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f036683d480 20 client.4683 send_request set sent_stamp to 2024-04-01T15:23:44.632240+0000 2024-04-01T15:23:44.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f036683d480 10 client.4683 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.627404+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f036683d480 1 -- 172.21.15.142:0/1290206522 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.627404+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d7cb670 con 0x7f0348003630 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f036683d480 20 client.4683 awaiting reply|forward|kick on 0x7ffc35e46ce0 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f03480092d0 con 0x7f0348003630 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.631+0000 7f0361e00640 10 client.4683 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f035401e040 con 0x7f0348003630 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 insert_trace from 2024-04-01T15:23:44.632240+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 features 0xffffffffffffffff 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 update_snap_trace len 70 2024-04-01T15:23:44.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 get_snap_realm 0x1 0x7f03480094f0, nref now is 1 2024-04-01T15:23:44.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 15 client.4683 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 15 client.4683 snapc 1=[] 2024-04-01T15:23:44.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 put_snap_realm 0x1 0x7f03480094f0 2 -> 1 2024-04-01T15:23:44.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f034800d520) - ctime 2024-04-01T15:21:58.495582+0000 mtime 2024-04-01T15:21:58.495582+0000 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 dir hash is 2 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 12 client.4683 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 12 client.4683 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=- has_dir_layout 0x7f034800d520) caps pAsLsXsFs 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 get_snap_realm 0x1 0x7f03480094f0, nref was 1 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 get_snap_realm 0x1 0x7f03480094f0, nref now is 2 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 15 client.4683 add_update_cap first one, opened snaprealm 0x7f03480094f0 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f034800d520) 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f034800d520) 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 put_snap_realm 0x1 0x7f03480094f0 2 -> 1 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 handle_client_reply signalling caller 0x7ffc35e46ce0 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 handle_client_reply awaiting kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 sendrecv kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 lat 0.001000 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 _ll_get 0x7f034800d520 0x1 -> 1 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 2 client.4683 unmount 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) n = 1 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) n = 1 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 unmounting: trim pass, size was 0+1 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 20 client.4683 trim_cache size 0 max 16384 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f0361e00640 10 client.4683 unmounting: trim pass, size still 0+1 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 2 client.4683 unmounting 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) n = 1 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) n = 1 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 10 client.4683 _ll_drop_pins 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 _ll_put 0x7f034800d520 0x1 1 -> 0 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) n = 1 2024-04-01T15:23:44.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) n = 1 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 10 client.4683 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 10 client.4683 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 10 client.4683 nothing to flush 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) n = 1 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) n = 1 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 10 client.4683 flush_caps_sync 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 10 client.4683 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 trim_cache size 0 max 16384 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 10 client.4683 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) n = 8 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 10 client.4683 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800d520) 2024-04-01T15:23:44.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 15 client.4683 remove_cap last one, closing snaprealm 0x7f03480094f0 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 20 client.4683 put_snap_realm 0x1 0x7f03480094f0 1 -> 0 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 10 client.4683 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=- COMPLETE has_dir_layout 0x7f034800d520) 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 2 client.4683 _close_mds_session mds.0 seq 0 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 1 -- 172.21.15.142:0/1290206522 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close) -- 0x564e0d74bd80 con 0x7f0348003630 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.632+0000 7f036683d480 2 client.4683 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x564e0d74bd80 con 0x7f0348003630 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 10 client.4683 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 5 client.4683 _closed_mds_session mds.0 seq 0 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 1 -- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 msgr2=0x564e0d7cea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cea70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 10 client.4683 remove_session_caps mds.0 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 10 client.4683 kick_requests_closed for mds.0 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 10 client.4683 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 20 client.4683 trim_cache size 0 max 16384 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f0361e00640 10 client.4683 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 2 client.4683 unmounted. 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 client.4683 shutdown 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 -- 172.21.15.142:0/1290206522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 msgr2=0x564e0d86f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d86f6c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f034c000c00 tx=0x7f034c002fb0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 -- 172.21.15.142:0/1290206522 shutdown_connections 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7cea70 unknown :-1 s=CLOSED pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d8776c0 0x564e0d748e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d86fd60 0x564e0d86f6c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 --2- 172.21.15.142:0/1290206522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d880850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 -- 172.21.15.142:0/1290206522 >> 172.21.15.142:0/1290206522 conn(0x564e0d750560 msgr2=0x564e0d751060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 -- 172.21.15.142:0/1290206522 shutdown_connections 2024-04-01T15:23:44.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 1 -- 172.21.15.142:0/1290206522 wait complete. 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.636+0000 7f036683d480 20 client.4683 trim_cache size 0 max 16384 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.637+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.638+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.638+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d8761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.638+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86fd60 0x564e0d7daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.638+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d8776c0 0x564e0d705940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.638+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0348004d30 con 0x564e0d8776c0 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.638+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d87ada0 con 0x564e0d86d2c0 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.638+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d87b2c0 con 0x564e0d86fd60 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.638+0000 7f0363c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d8776c0 0x564e0d705940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0363200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d8761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0363c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d8776c0 0x564e0d705940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52980/0 (socket says 172.21.15.142:52980) 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0363c00640 1 -- 172.21.15.142:0/3097282784 learned_addr learned my addr 172.21.15.142:0/3097282784 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f035a800640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86fd60 0x564e0d7daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0363c00640 1 -- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86fd60 msgr2=0x564e0d7daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0363c00640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86fd60 0x564e0d7daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0363c00640 1 -- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 msgr2=0x564e0d8761f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0363c00640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d86d2c0 0x564e0d8761f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0363c00640 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d872500 con 0x564e0d8776c0 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f035a800640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d86fd60 0x564e0d7daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0363c00640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d8776c0 0x564e0d705940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f035c0030a0 tx=0x7f035c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8768022f5d310505 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.639+0000 7f0360a00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c07e060 con 0x564e0d8776c0 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f035c019bf0 con 0x564e0d8776c0 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f036683d480 10 client.4686 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d874be0 con 0x564e0d8776c0 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0359400640 20 client.4686 tick 2024-04-01T15:23:44.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0359400640 20 client.4686 collect_and_send_metrics 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0359400640 20 client.4686 collect_and_send_global_metrics 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0359400640 5 client.4686 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0359400640 20 client.4686 trim_cache size 0 max 16384 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0359400640 20 client.4686 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035c052640 con 0x564e0d8776c0 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f035c076040 con 0x564e0d8776c0 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f0360a00640 1 client.4686 handle_mds_map epoch 8 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f036683d480 20 client.4686 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f036683d480 10 client.4686 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f036683d480 20 client.4686 mds is 0 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f036683d480 10 client.4686 _open_mds_session mds.0 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f036683d480 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7d5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d705ff0 con 0x7f0348003630 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.640+0000 7f036683d480 10 client.4686 waiting for session to mds.0 to open 2024-04-01T15:23:44.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.641+0000 7f0363200640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7d5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.641+0000 7f0363200640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7d5f40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6916ab7c7a4ffb87 server_cookie=9d2ace65d600483e in_seq=0 out_seq=0 2024-04-01T15:23:44.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.641+0000 7f0360a00640 10 client.4686 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d705ff0 con 0x7f0348003630 2024-04-01T15:23:44.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f0360a00640 10 client.4686 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f0360a00640 10 client.4686 renew_caps mds.0 2024-04-01T15:23:44.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f034800d7d0 con 0x7f0348003630 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f0360a00640 10 client.4686 connect_mds_targets for mds.0 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f036683d480 10 client.4686 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f036683d480 20 client.4686 mds is 0 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f036683d480 10 client.4686 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f036683d480 20 client.4686 encode_cap_releases enter (req: 0x564e0d7d5b80, mds: 0) 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f036683d480 20 client.4686 send_request set sent_stamp to 2024-04-01T15:23:44.646658+0000 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f036683d480 10 client.4686 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.641617+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.641617+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d7ce8e0 con 0x7f0348003630 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f036683d480 20 client.4686 awaiting reply|forward|kick on 0x7ffc35e468a0 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f034800d7d0 con 0x7f0348003630 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.645+0000 7f0360a00640 10 client.4686 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f035401e040 con 0x7f0348003630 2024-04-01T15:23:44.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 insert_trace from 2024-04-01T15:23:44.646658+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 features 0xffffffffffffffff 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 update_snap_trace len 70 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0x7f034800d9f0, nref now is 1 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 15 client.4686 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 15 client.4686 snapc 1=[] 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 put_snap_realm 0x1 0x7f034800d9f0 2 -> 1 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f034800dae0) - ctime 2024-04-01T15:21:58.495582+0000 mtime 2024-04-01T15:21:58.495582+0000 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 dir hash is 2 2024-04-01T15:23:44.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 12 client.4686 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 12 client.4686 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=- has_dir_layout 0x7f034800dae0) caps pAsLsXsFs 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0x7f034800d9f0, nref was 1 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0x7f034800d9f0, nref now is 2 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 15 client.4686 add_update_cap first one, opened snaprealm 0x7f034800d9f0 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 10 client.4686 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 put_snap_realm 0x1 0x7f034800d9f0 2 -> 1 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 handle_client_reply signalling caller 0x7ffc35e468a0 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 handle_client_reply awaiting kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 sendrecv kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 lat 0.001093 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 _ll_get 0x7f034800dae0 0x1 -> 1 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f0360a00640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 8 client.4686 _ll_create 0x1.head test_llreadvllwritevfile45288 0666 578, uid 0, gid 0 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 10 client.4686 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0) dn 'test_llreadvllwritevfile45288' 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0); UserPerm(uid: 0, gid: 0) 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 10 client.4686 _getattr mask As issued=1 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 3 client.4686 may_create 0x7f034800dae0 = 0 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 8 client.4686 _create(0x1 test_llreadvllwritevfile45288, 0666) 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0) name test_llreadvllwritevfile45288 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 15 open_dir 0x564e0d7523c0 on 0x7f034800dae0 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 15 client.4686 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0) 'test_llreadvllwritevfile45288' dn 0x1.head["test_llreadvllwritevfile45288"] (new dn) 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 choose_target_mds inode dir hash is 2 on test_llreadvllwritevfile45288 => 2533761758 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0) is_hash=1 hash=2533761758 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 10 client.4686 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 mds is 0 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 10 client.4686 send_request rebuilding request 2 for mds.0 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 encode_cap_releases enter (req: 0x564e0d7cec30, mds: 0) 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 encode_dentry_release enter(dn:0x7f034800ae20) 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f034800dae0), req:0x564e0d7cec30 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 send_request set sent_stamp to 2024-04-01T15:23:44.647837+0000 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 10 client.4686 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevfile45288 2024-04-01T15:23:44.647815+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevfile45288 2024-04-01T15:23:44.647815+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d7dfdd0 con 0x7f0348003630 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.646+0000 7f036683d480 20 client.4686 awaiting reply|forward|kick on 0x7ffc35e466e0 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 850+0+0 (crc 0 0 0) 0x7f035401fcd0 con 0x7f0348003630 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 handle_client_reply got a reply. Safe:1 tid 2 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 insert_trace from 2024-04-01T15:23:44.647837+0000 mds.0 is_target=1 is_dentry=1 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 features 0xffffffffffffffff 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 update_snap_trace len 70 2024-04-01T15:23:44.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0x7f034800d9f0, nref was 1 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0x7f034800d9f0, nref now is 2 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 hrm is_target=1 is_dentry=1 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 update_inode_file_time 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f034800e0c0) - ctime 2024-04-01T15:23:44.647815+0000 mtime 2024-04-01T15:23:44.647815+0000 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 12 client.4686 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 12 client.4686 add_update_inode adding 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=- objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f034800e0c0) caps pAsxLsXsxFsxcrwb 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0x7f034800d9f0, nref was 2 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0x7f034800d9f0, nref now is 3 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 15 client.4686 add_update_cap first one, opened snaprealm 0x7f034800d9f0 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f034800e0c0) 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 12 client.4686 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) caps pAsLsXs 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:21:58.495582+0000 ctime=2024-04-01T15:21:58.495582+0000 change_attr=0 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) pAsLsXs ctime 2024-04-01T15:23:44.647815+0000 mtime 2024-04-01T15:23:44.647815+0000 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 dir hash is 2 2024-04-01T15:23:44.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 12 client.4686 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 1 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 got dirfrag map for 0x1 frag * to mds 0 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 12 client.4686 insert_dentry_inode 'test_llreadvllwritevfile45288' vino 0x10000000000.head in dir 0x1.head dn 0x7f034800ae20 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 15 client.4686 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) 'test_llreadvllwritevfile45288' to inode 0x7f034800e0c0 dn 0x1.head["test_llreadvllwritevfile45288"] (old dn) 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 link inode 0x7f034800e0c0 parents now 0x1.head["test_llreadvllwritevfile45288"] 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 15 client.4686 update_dentry_lease 0x1.head["test_llreadvllwritevfile45288"] lease(mask 7 dur 30000) from 2024-04-01T15:23:44.647837+0000 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 10 client.4686 got dentry lease on test_llreadvllwritevfile45288 dur 30000ms ttl 2024-04-01T15:24:14.647837+0000 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 put_snap_realm 0x1 0x7f034800d9f0 3 -> 2 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 handle_client_reply signalling caller 0x7ffc35e466e0 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 handle_client_reply awaiting kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 20 client.4686 sendrecv kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 10 client.4686 delegated_inos: [] 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 10 client.4686 make_request created ino 0x10000000000 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 20 client.4686 make_request target is 0x10000000000.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 20 client.4686 lat 0.007865 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 10 break_deleg: breaking delegs on 0x10000000000.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 10 delegations_broken: delegations empty on 0x10000000000.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 10 client.4686 _create_fh 0x10000000000 mode 3 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 20 client.4686 trim_cache size 1 max 16384 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 8 client.4686 create(#0x1/test_llreadvllwritevfile45288, 0100666 layout 0 0 0) = 0 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 20 client.4686 _ll_create created = 1 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 8 client.4686 _ll_create 0x1.head test_llreadvllwritevfile45288 0666 578 = 0 (0x564e0d7e0190 10000000000) 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 20 client.4686 _ll_get 0x7f034800e0c0 0x10000000000 -> 1 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 10 client.4686 fill_statx on 0x10000000000 snap/devhead mode 0100666 mtime 2024-04-01T15:23:44.647815+0000 ctime 2024-04-01T15:23:44.647815+0000 change_attr 0 2024-04-01T15:23:44.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 10 client.4686 get_quota_root realm 0x1 2024-04-01T15:23:44.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-01T15:23:44.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 10 client.4686 cur file size is 0 2024-04-01T15:23:44.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x564e0d71cc20 0x564e0d71f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] -- osd_op(unknown.0.0:1 3.30 3:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x7f034800ca90 con 0x564e0d71cc20 2024-04-01T15:23:44.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] -- osd_op(unknown.0.0:2 3.30 3:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x7f034800b5c0 con 0x564e0d71cc20 2024-04-01T15:23:44.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.654+0000 7f0360a00640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.655+0000 7f035a800640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x564e0d71cc20 0x564e0d71f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.656+0000 7f035a800640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x564e0d71cc20 0x564e0d71f0b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=427151f831b4e470 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.656+0000 7f0360a00640 10 client.4686 ms_handle_connect on v2:172.21.15.179:6817/1223314628 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.657+0000 7f035a800640 1 -- 172.21.15.142:0/3097282784 <== osd.5 v2:172.21.15.179:6817/1223314628 1 ==== osd_op_reply(1 10000000000.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f034c00b5b0 con 0x564e0d71cc20 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f035a800640 1 -- 172.21.15.142:0/3097282784 <== osd.5 v2:172.21.15.179:6817/1223314628 2 ==== osd_op_reply(2 10000000000.00000000 [create] v22'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f034c00b5b0 con 0x564e0d71cc20 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 wanted_max_size 0 -> 14 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 20 client.4686 clear_suid_sgid 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0); UserPerm(uid: 0, gid: 0) defer 0 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 5 client.4686 get_cap_ref got first FILE_BUFFER ref on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 5 client.4686 get_cap_ref got first FILE_CACHE ref on 0x10000000000.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={4=0,1024=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 3 client.4686 pwritev(0x564e0d7e0190, "...", 14, 0) = 0 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) - -> Fw 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 get_quota_root realm 0x1 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 7 client.4686 wrote to 14, extending file size 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661419+0000 ctime=2024-04-01T15:23:44.661419+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) Fw -> Fw 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661419+0000 ctime=2024-04-01T15:23:44.661419+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 19 client.4686 C_Write_Finisher::try_complete this 0x564e0d666140 onuninlinefinished 1 iofinished 1 iofinished_r 14 fsync_finished 1 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 19 client.4686 complete with iofinished_r 14 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661419+0000 ctime=2024-04-01T15:23:44.661419+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 _read_async 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661419+0000 ctime=2024-04-01T15:23:44.661419+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 0~14 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 3 client.4686 preadv(0x564e0d7e0190, 0) = 0 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 get_quota_root realm 0x1 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-01T15:23:44.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 cur file size is 14 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 wanted_max_size 14 -> 126 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661419+0000 ctime=2024-04-01T15:23:44.661419+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 20 client.4686 clear_suid_sgid 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661419+0000 ctime=2024-04-01T15:23:44.661419+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0); UserPerm(uid: 0, gid: 0) defer 0 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 3 client.4686 pwritev(0x564e0d7e0190, "...", 26, 100) = 0 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661419+0000 ctime=2024-04-01T15:23:44.661419+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) Fw -> Fw 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661419+0000 ctime=2024-04-01T15:23:44.661419+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 get_quota_root realm 0x1 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 7 client.4686 wrote to 126, extending file size 2024-04-01T15:23:44.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661542+0000 ctime=2024-04-01T15:23:44.661542+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) Fw -> Fw 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661542+0000 ctime=2024-04-01T15:23:44.661542+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 19 client.4686 C_Write_Finisher::try_complete this 0x564e0d6cf130 onuninlinefinished 1 iofinished 1 iofinished_r 26 fsync_finished 1 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 19 client.4686 complete with iofinished_r 26 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661542+0000 ctime=2024-04-01T15:23:44.661542+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 _read_async 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=1,4096=0,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661542+0000 ctime=2024-04-01T15:23:44.661542+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 100~26 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 3 client.4686 preadv(0x564e0d7e0190, 100) = 0 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 get_quota_root realm 0x1 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 cur file size is 126 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 wanted_max_size 126 -> 1031 2024-04-01T15:23:44.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661542+0000 ctime=2024-04-01T15:23:44.661542+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 20 client.4686 clear_suid_sgid 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661542+0000 ctime=2024-04-01T15:23:44.661542+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0); UserPerm(uid: 0, gid: 0) defer 0 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 10 client.4686 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f036683d480 3 client.4686 pwritev(0x564e0d7e0190, "...", 31, 1000) = 0 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661542+0000 ctime=2024-04-01T15:23:44.661542+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) Fw -> Fw 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661542+0000 ctime=2024-04-01T15:23:44.661542+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 get_quota_root realm 0x1 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 7 client.4686 wrote to 1031, extending file size 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) Fw -> Fw 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 19 client.4686 C_Write_Finisher::try_complete this 0x564e0d68ed30 onuninlinefinished 1 iofinished 1 iofinished_r 31 fsync_finished 0 2024-04-01T15:23:44.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 19 client.4686 kickoff fsync onfinish 0x564e0d7ce6c0 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 15 client.4686 Client::C_nonblocking_fsync_state::advance progress 0 flush_wait 0 flush_completed 0 result 0 waitfor_safe 0 onfinish 0x564e0d7e07e0 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 0 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 _flush 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] -- osd_op(unknown.0.0:3 3.30 3:0cf6ad0f:::10000000000.00000000:head [write 0~14 in=14b,write 100~26 in=26b,write 1000~31 in=31b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x7f0330002840 con 0x564e0d71cc20 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 15 client.4686 using return-valued form of _fsync 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 check_caps on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) wanted pAsxXsxFsxcrwb used Fcwb issued pAsxLsXsxFsxcrwb revoking - flags=3 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 mark_caps_flushing Fw 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 mark_caps_clean 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 10 client.4686 send_cap 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) mds.0 seq 1 used Fcwb want pAsxXsxFsxcrwb flush Fw retain pAsxLsxXsxFsxcrwbl held pAsxLsXsxFsxcrwb revoking - dropping - 2024-04-01T15:23:44.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 15 client.4686 auth cap, requesting max_size 1031 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_caps(update ino 0x10000000000 1 seq 1 tid 2 caps=pAsxLsXsxFsxcrwb dirty=Fw wanted=pAsxXsxFsxcrwb follows 1 size 1031/1031 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.661647+0000 ctime 2024-04-01T15:23:44.661647+0000 change_attr 3) -- 0x7f0330002fc0 con 0x7f0348003630 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 1 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.660+0000 7f0365c00640 15 client.4686 waiting on data to flush 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035a800640 1 -- 172.21.15.142:0/3097282784 <== osd.5 v2:172.21.15.179:6817/1223314628 3 ==== osd_op_reply(3 10000000000.00000000 [write 0~14,write 100~26,write 1000~31] v22'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f034c00b5b0 con 0x564e0d71cc20 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 10 client.4686 _flushed 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 5 client.4686 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 5 client.4686 put_cap_ref dropped last FILE_CACHE ref on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 2 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 15 client.4686 complete_flush r 0 progress 2 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 15 client.4686 Client::C_nonblocking_fsync_state::advance progress 2 flush_wait 1 flush_completed 1 result 0 waitfor_safe 0 onfinish 0x564e0d7e07e0 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 2 2024-04-01T15:23:44.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 15 client.4686 got 0 from flush writeback 2024-04-01T15:23:44.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 3 2024-04-01T15:23:44.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 15 client.4686 in->flushing_cap_tids.empty() 0 in->flushing_caps 4096 2024-04-01T15:23:44.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 15 client.4686 Client::C_nonblocking_fsync_state::advance - flushing_caps 2024-04-01T15:23:44.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 15 client.4686 Client::C_nonblocking_fsync_state::advance it->first 2 flush_tid 2 2024-04-01T15:23:44.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 10 client.4686 advance on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) flushing Fw flush_tid 2 last 2 2024-04-01T15:23:44.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.664+0000 7f035b400640 10 client.4686 Adding onfinish 0x564e0d7e07e0 for C_nonblocking_fsync_state 0x7f0330001d60 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 5 ==== client_caps(flush_ack ino 0x10000000000 1 seq 1 tid 2 caps=pAsxLsXsxFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f0330002fc0 con 0x7f0348003630 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 5 client.4686 set_cap_epoch_barrier epoch = 20 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 10 client.4686 mds.0 seq now 1 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 5 client.4686 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) with Fw 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 5 client.4686 flushing_caps Fw -> - 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 10 client.4686 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) !flushing 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 10 client.4686 handle_cap_flush_ack calling signal_caps_inode 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 15 client.4686 C_nonblocking_fsync_state_advancer::finish r 0 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 15 client.4686 Client::C_nonblocking_fsync_state::advance progress 4 flush_wait 1 flush_completed 1 result 0 waitfor_safe 0 onfinish 0x564e0d7e07e0 2024-04-01T15:23:44.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 4 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 15 client.4686 in->flushing_cap_tids.empty() 1 in->flushing_caps 0 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 10 client.4686 ino 0x10000000000 has no uncommitted writes 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 3 client.4686 finish_fsync r = 0 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 19 client.4686 C_Write_Finisher::try_complete this 0x564e0d68ed30 onuninlinefinished 1 iofinished 1 iofinished_r 31 fsync_finished 1 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 19 client.4686 complete with iofinished_r 31 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f0360a00640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 _read_async 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=1,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 1000~31 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 5 client.4686 get_cap_ref got first FILE_CACHE ref on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=1,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 5 client.4686 put_cap_ref dropped last FILE_CACHE ref on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=1,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=1,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 3 client.4686 preadv(0x564e0d7e0190, 1000) = 0 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 3 client.4686 ll_release (fh)0x564e0d7e0190 0x10000000000 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 8 client.4686 _release_fh 0x564e0d7e0190 mode 3 on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 _flush 0x10000000000.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 nothing to flush 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 check_caps on 0x10000000000.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) wanted - used Fc issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 delaying cap release 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 _release_fh 0x564e0d7e0190 on inode 0x10000000000.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) no async_err state 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 3 client.4686 ll_unlink 0x1.head test_llreadvllwritevfile45288 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0); ; name test_llreadvllwritevfile45288; UserPerm(uid: 0, gid: 0) 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 _getattr mask As issued=1 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 3 client.4686 may_delete 0x7f034800dae0 = 0 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 8 client.4686 _unlink(0x1 test_llreadvllwritevfile45288 uid 0 gid 0) 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) name test_llreadvllwritevfile45288 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 _lookup have 0x1.head["test_llreadvllwritevfile45288"] from mds.0 ttl 2024-04-01T15:24:14.647837+0000 seq 2 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) test_llreadvllwritevfile45288 = 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 break_deleg: breaking delegs on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 delegations_broken: delegations empty on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 choose_target_mds inode dir hash is 2 on test_llreadvllwritevfile45288 => 2533761758 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) is_hash=1 hash=2533761758 2024-04-01T15:23:44.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 choose_target_mds from dirfragtree hash 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 mds is 0 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 send_request rebuilding request 3 for mds.0 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 encode_cap_releases enter (req: 0x564e0d7e0330, mds: 0) 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 encode_inode_release enter(in:0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0), req:0x564e0d7e0330 mds:0, drop:Lsx, unless:-, force:0) 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 encode_dentry_release enter(dn:0x7f034800ae20) 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0), req:0x564e0d7e0330 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 send_request set sent_stamp to 2024-04-01T15:23:44.667014+0000 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 10 client.4686 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevfile45288 2024-04-01T15:23:44.666993+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevfile45288 2024-04-01T15:23:44.666993+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d88a670 con 0x7f0348003630 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.665+0000 7f036683d480 20 client.4686 awaiting reply|forward|kick on 0x7ffc35e468c0 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.666+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 6 ==== client_caps(revoke ino 0x10000000000 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 1031/4194304 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.661647+0000 ctime 2024-04-01T15:23:44.661647+0000 change_attr 3) ==== 260+0+0 (crc 0 0 0) 0x7f0354023040 con 0x7f0348003630 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.666+0000 7f0360a00640 10 client.4686 mds.0 seq now 2 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.666+0000 7f0360a00640 5 client.4686 handle_cap_grant on in 0x10000000000 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-01T15:23:44.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.666+0000 7f0360a00640 10 client.4686 update_inode_file_time 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) pAsxXsxFsxcrwb ctime 2024-04-01T15:23:44.661647+0000 mtime 2024-04-01T15:23:44.661647+0000 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.666+0000 7f0360a00640 10 client.4686 revocation of AxXx 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.666+0000 7f0360a00640 10 client.4686 check_caps on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) wanted - used Fc issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.667+0000 7f0360a00640 10 client.4686 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.667+0000 7f0360a00640 10 client.4686 completed revocation of AxXx 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.667+0000 7f0360a00640 10 client.4686 send_cap 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile45288"] 0x7f034800e0c0) mds.0 seq 2 used Fc want - flush - retain pAsLsXsFsc held pAsxXsxFsxcrwb revoking AxXx dropping Fxrwb 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.667+0000 7f0360a00640 15 client.4686 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.667+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_caps(update ino 0x10000000000 1 seq 2 caps=pAsXsFsc dirty=- wanted=- follows 0 size 1031/4194304 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.661647+0000 ctime 2024-04-01T15:23:44.661647+0000 change_attr 3) -- 0x7f0330002fc0 con 0x7f0348003630 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.667+0000 7f0360a00640 10 client.4686 handle_cap_grant calling signal_caps_inode 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 7 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 498+0+0 (crc 0 0 0) 0x7f0354017440 con 0x7f0348003630 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 handle_client_reply got a reply. Safe:0 tid 3 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 insert_trace from 2024-04-01T15:23:44.667014+0000 mds.0 is_target=0 is_dentry=1 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 features 0xffffffffffffffff 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 update_snap_trace len 70 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0x7f034800d9f0, nref was 2 2024-04-01T15:23:44.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 get_snap_realm 0x1 0x7f034800d9f0, nref now is 3 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 hrm is_target=0 is_dentry=1 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 12 client.4686 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) caps pAsLsXs 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.647815+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) pAsLsXs ctime 2024-04-01T15:23:44.666993+0000 mtime 2024-04-01T15:23:44.647815+0000 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 dir hash is 2 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 12 client.4686 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 2 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 got dirfrag map for 0x1 frag * to mds 0 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 15 client.4686 unlink dir 0x7f034800dae0 'test_llreadvllwritevfile45288' dn 0x7f034800ae20 inode 0x7f034800e0c0 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 unlink inode 0x7f034800e0c0 parents now 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 15 client.4686 update_dentry_lease 0x1.head["test_llreadvllwritevfile45288"] lease(mask 3 dur 30000) from 2024-04-01T15:23:44.667014+0000 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 got dentry lease on test_llreadvllwritevfile45288 dur 30000ms ttl 2024-04-01T15:24:14.667014+0000 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 put_snap_realm 0x1 0x7f034800d9f0 3 -> 2 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 handle_client_reply signalling caller 0x7ffc35e468c0 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 handle_client_reply awaiting kickback on tid 3 0x7f03609fde80 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 20 client.4686 sendrecv kickback on tid 3 0x7f03609fde80 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 20 client.4686 lat 0.003465 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 20 client.4686 trim_cache size 1 max 16384 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 8 client.4686 unlink(#0x1/test_llreadvllwritevfile45288) = 0 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 2 client.4686 unmount 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 2 client.4686 unmounting 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_flushmdlog) -- 0x564e0d74ee70 con 0x7f0348003630 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 10 client.4686 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 unmounting: trim pass, size was 1+2 2024-04-01T15:23:44.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 20 client.4686 trim_cache size 1 max 16384 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f0360a00640 10 client.4686 unmounting: trim pass, size still 1+2 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.670+0000 7f036683d480 10 client.4686 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 8 ==== client_caps(grant ino 0x10000000000 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 1031/0 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.661647+0000 ctime 2024-04-01T15:23:44.666993+0000 change_attr 4) ==== 260+0+0 (crc 0 0 0) 0x7f0330002fc0 con 0x7f0348003630 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 mds.0 seq now 3 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 5 client.4686 handle_cap_grant on in 0x10000000000 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFsc 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 update_inode_file_time 0x10000000000.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.661647+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) pAsXsFsc ctime 2024-04-01T15:23:44.666993+0000 mtime 2024-04-01T15:23:44.661647+0000 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 max_size 4194304 -> 0 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 grant, new caps are LsFxrwb 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 handle_cap_grant calling signal_caps_inode 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 5 client.4686 _try_to_trim_inode in 0x10000000000.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 unmounting: trim pass, size was 1+2 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 20 client.4686 trim_cache size 1 max 16384 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 unmounting: trim pass, size still 1+2 2024-04-01T15:23:44.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 9 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f0354017630 con 0x7f0348003630 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 20 client.4686 handle_client_reply got a reply. Safe:1 tid 3 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 insert_trace from 2024-04-01T15:23:44.667014+0000 mds.0 is_target=0 is_dentry=0 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 insert_trace -- already got unsafe; ignoring 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 unmounting: trim pass, size was 1+2 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 20 client.4686 trim_cache size 1 max 16384 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 15 client.4686 trim_dentry unlinking dn test_llreadvllwritevfile45288 in dir 0x1 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 15 client.4686 unlink dir 0x7f034800dae0 'test_llreadvllwritevfile45288' dn 0x7f034800ae20 inode 0 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 15 client.4686 unlink removing 'test_llreadvllwritevfile45288' dn 0x7f034800ae20 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 15 client.4686 close_dir dir 0x564e0d7523c0 on 0x7f034800dae0 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 unmounting: trim pass, cache shrank, poking unmount() 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 _ll_drop_pins 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 _ll_put 0x7f034800e0c0 0x10000000000 1 -> 0 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 _ll_put 0x7f034800dae0 0x1 2 -> 0 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 _release 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 _invalidate_inode_cache 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f034800e0c0) 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 _flush 0x10000000000.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f034800e0c0) 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 nothing to flush 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 nothing to flush 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f034800e0c0) n = 1 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 1 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 flush_caps_sync 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 trim_cache size 0 max 16384 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) n = 11 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 15 client.4686 remove_cap last one, closing snaprealm 0x7f034800d9f0 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_snap_realm 0x1 0x7f034800d9f0 2 -> 1 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.647815+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=- COMPLETE has_dir_layout 0x7f034800dae0) 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 _put_inode on 0x10000000000.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f034800e0c0) n = 20 2024-04-01T15:23:44.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 remove_cap mds.0 on 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f034800e0c0) 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 15 client.4686 remove_cap last one, closing snaprealm 0x7f034800d9f0 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 20 client.4686 put_snap_realm 0x1 0x7f034800d9f0 1 -> 0 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 10 client.4686 _put_inode deleting 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-01T15:23:44.647815+0000 mtime=2024-04-01T15:23:44.661647+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=4 caps=- objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f034800e0c0) 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 2 client.4686 _close_mds_session mds.0 seq 3 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close seq 3) -- 0x564e0d720000 con 0x7f0348003630 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f036683d480 2 client.4686 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 10 ==== client_caps(grant ino 0x10000000000 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 1031/0 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.661647+0000 ctime 2024-04-01T15:23:44.666993+0000 change_attr 4) ==== 260+0+0 (crc 0 0 0) 0x7f0354013040 con 0x7f0348003630 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 mds.0 seq now 4 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close seq 4) -- 0x7f034800d7d0 con 0x7f0348003630 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 5 client.4686 handle_caps don't have vino 0x10000000000.head op 0, immediately releasing 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_cap_release(3) -- 0x564e0d71fe50 con 0x7f0348003630 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 20 client.4686 trim_cache size 0 max 16384 2024-04-01T15:23:44.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.675+0000 7f0360a00640 10 client.4686 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.679+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 <== mds.0 v2:172.21.15.179:6834/1191595510 11 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x7f034800d7d0 con 0x7f0348003630 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0360a00640 10 client.4686 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0360a00640 5 client.4686 _closed_mds_session mds.0 seq 4 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0360a00640 1 -- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 msgr2=0x564e0d7d5f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0360a00640 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x7f0348003630 0x564e0d7d5f40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0360a00640 10 client.4686 remove_session_caps mds.0 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0360a00640 10 client.4686 kick_requests_closed for mds.0 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0360a00640 10 client.4686 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0360a00640 20 client.4686 trim_cache size 0 max 16384 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0360a00640 10 client.4686 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 2 client.4686 unmounted. 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 1 client.4686 shutdown 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x564e0d71cc20 msgr2=0x564e0d71f0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x564e0d71cc20 0x564e0d71f0b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d8776c0 msgr2=0x564e0d705940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 1 --2- 172.21.15.142:0/3097282784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d8776c0 0x564e0d705940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f035c0030a0 tx=0x7f035c00c040 comp rx=0 tx=0).stop 2024-04-01T15:23:44.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f0363c00640 1 -- 172.21.15.142:0/3097282784 reap_dead start 2024-04-01T15:23:44.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 shutdown_connections 2024-04-01T15:23:44.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 >> 172.21.15.142:0/3097282784 conn(0x564e0d750560 msgr2=0x564e0d709240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 shutdown_connections 2024-04-01T15:23:44.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 1 -- 172.21.15.142:0/3097282784 wait complete. 2024-04-01T15:23:44.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.680+0000 7f036683d480 20 client.4686 trim_cache size 0 max 16384 2024-04-01T15:23:44.702 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestClient.LlreadvLlwritev (58 ms) 2024-04-01T15:23:44.702 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestClient.LlreadvLlwritevNullContext 2024-04-01T15:23:44.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.681+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.682+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.682+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d880950 0x564e0d7058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.682+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d713da0 0x564e0d748e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.682+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 0x564e0d74e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.682+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0348007980 con 0x564e0d880950 2024-04-01T15:23:44.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.682+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d87b6b0 con 0x564e0d713da0 2024-04-01T15:23:44.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.682+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d714230 con 0x564e0d871d50 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.683+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d880950 0x564e0d7058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.683+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d880950 0x564e0d7058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52996/0 (socket says 172.21.15.142:52996) 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.683+0000 7f0363200640 1 -- 172.21.15.142:0/3959453797 learned_addr learned my addr 172.21.15.142:0/3959453797 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.683+0000 7f0363c00640 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 0x564e0d74e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.683+0000 7f035a800640 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d713da0 0x564e0d748e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0363200640 1 -- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 msgr2=0x564e0d74e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0363200640 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 0x564e0d74e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0363200640 1 -- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d713da0 msgr2=0x564e0d748e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0363200640 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d713da0 0x564e0d748e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0363200640 1 -- 172.21.15.142:0/3959453797 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d751060 con 0x564e0d880950 2024-04-01T15:23:44.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0363c00640 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 0x564e0d74e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f036683d480 10 client.4689 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f036683d480 1 -- 172.21.15.142:0/3959453797 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mdsmap=0+}) -- 0x564e0d751400 con 0x564e0d880950 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0361e00640 10 client.4689 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0363200640 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d880950 0x564e0d7058a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0354004510 tx=0x7f0354001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bcb7678e68ad12 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0358a00640 20 client.4689 tick 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0358a00640 20 client.4689 collect_and_send_metrics 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0358a00640 20 client.4689 collect_and_send_global_metrics 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0358a00640 5 client.4689 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0358a00640 20 client.4689 trim_cache size 0 max 16384 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.684+0000 7f0358a00640 20 client.4689 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f0361e00640 1 -- 172.21.15.142:0/3959453797 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035403d060 con 0x564e0d880950 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f0361e00640 1 -- 172.21.15.142:0/3959453797 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f035401f2a0 con 0x564e0d880950 2024-04-01T15:23:44.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f0361e00640 1 -- 172.21.15.142:0/3959453797 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f035401fe50 con 0x564e0d880950 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f0361e00640 1 client.4689 handle_mds_map epoch 8 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f036683d480 20 client.4689 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f036683d480 10 client.4689 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f036683d480 20 client.4689 mds is 0 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f036683d480 10 client.4689 _open_mds_session mds.0 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f036683d480 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8760e0 0x564e0d86f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f036683d480 1 -- 172.21.15.142:0/3959453797 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d705ff0 con 0x564e0d8760e0 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.685+0000 7f036683d480 10 client.4689 waiting for session to mds.0 to open 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.686+0000 7f035a800640 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8760e0 0x564e0d86f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.686+0000 7f035a800640 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8760e0 0x564e0d86f0d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a60e2707be12d630 server_cookie=9023fba8143015f5 in_seq=0 out_seq=0 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.686+0000 7f0361e00640 10 client.4689 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f0361e00640 1 -- 172.21.15.142:0/3959453797 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d705ff0 con 0x564e0d8760e0 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f0361e00640 10 client.4689 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f0361e00640 10 client.4689 renew_caps mds.0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f0361e00640 1 -- 172.21.15.142:0/3959453797 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f0330009c30 con 0x564e0d8760e0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f0361e00640 10 client.4689 connect_mds_targets for mds.0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f036683d480 10 client.4689 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f036683d480 20 client.4689 mds is 0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f036683d480 10 client.4689 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f036683d480 20 client.4689 encode_cap_releases enter (req: 0x564e0d875cd0, mds: 0) 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f036683d480 20 client.4689 send_request set sent_stamp to 2024-04-01T15:23:44.691660+0000 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f036683d480 10 client.4689 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.686521+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f036683d480 1 -- 172.21.15.142:0/3959453797 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.686521+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d86f7c0 con 0x564e0d8760e0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f036683d480 20 client.4689 awaiting reply|forward|kick on 0x7ffc35e46ce0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f0361e00640 1 -- 172.21.15.142:0/3959453797 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f0330009c30 con 0x564e0d8760e0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.690+0000 7f0361e00640 10 client.4689 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 1 -- 172.21.15.142:0/3959453797 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f034c011040 con 0x564e0d8760e0 2024-04-01T15:23:44.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 insert_trace from 2024-04-01T15:23:44.691660+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 features 0xffffffffffffffff 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 update_snap_trace len 70 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 get_snap_realm 0x1 0x7f0330009e50, nref now is 1 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 15 client.4689 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 15 client.4689 snapc 1=[] 2024-04-01T15:23:44.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 put_snap_realm 0x1 0x7f0330009e50 2 -> 1 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f0330009f40) - ctime 2024-04-01T15:23:44.666993+0000 mtime 2024-04-01T15:23:44.666993+0000 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 dir hash is 2 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 12 client.4689 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 2 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 12 client.4689 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=- has_dir_layout 0x7f0330009f40) caps pAsLsXsFs 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 get_snap_realm 0x1 0x7f0330009e50, nref was 1 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 get_snap_realm 0x1 0x7f0330009e50, nref now is 2 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 15 client.4689 add_update_cap first one, opened snaprealm 0x7f0330009e50 2024-04-01T15:23:44.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f0330009f40) 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f0330009f40) 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 put_snap_realm 0x1 0x7f0330009e50 2 -> 1 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 handle_client_reply signalling caller 0x7ffc35e46ce0 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 handle_client_reply awaiting kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 sendrecv kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 lat 0.001177 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 _ll_get 0x7f0330009f40 0x1 -> 1 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 2 client.4689 unmount 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) n = 1 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) n = 1 2024-04-01T15:23:44.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 unmounting: trim pass, size was 0+1 2024-04-01T15:23:44.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 20 client.4689 trim_cache size 0 max 16384 2024-04-01T15:23:44.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f0361e00640 10 client.4689 unmounting: trim pass, size still 0+1 2024-04-01T15:23:44.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 2 client.4689 unmounting 2024-04-01T15:23:44.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) n = 1 2024-04-01T15:23:44.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) n = 1 2024-04-01T15:23:44.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 10 client.4689 _ll_drop_pins 2024-04-01T15:23:44.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 _ll_put 0x7f0330009f40 0x1 1 -> 0 2024-04-01T15:23:44.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) n = 1 2024-04-01T15:23:44.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) n = 1 2024-04-01T15:23:44.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) 2024-04-01T15:23:44.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 10 client.4689 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) 2024-04-01T15:23:44.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 10 client.4689 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) 2024-04-01T15:23:44.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 10 client.4689 nothing to flush 2024-04-01T15:23:44.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) n = 1 2024-04-01T15:23:44.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) n = 1 2024-04-01T15:23:44.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 10 client.4689 flush_caps_sync 2024-04-01T15:23:44.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 10 client.4689 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-01T15:23:44.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 trim_cache size 0 max 16384 2024-04-01T15:23:44.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 10 client.4689 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) n = 8 2024-04-01T15:23:44.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 10 client.4689 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0330009f40) 2024-04-01T15:23:44.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 15 client.4689 remove_cap last one, closing snaprealm 0x7f0330009e50 2024-04-01T15:23:44.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 20 client.4689 put_snap_realm 0x1 0x7f0330009e50 1 -> 0 2024-04-01T15:23:44.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 10 client.4689 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=- COMPLETE has_dir_layout 0x7f0330009f40) 2024-04-01T15:23:44.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 2 client.4689 _close_mds_session mds.0 seq 0 2024-04-01T15:23:44.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 1 -- 172.21.15.142:0/3959453797 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close) -- 0x564e0d7203d0 con 0x564e0d8760e0 2024-04-01T15:23:44.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.691+0000 7f036683d480 2 client.4689 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 1 -- 172.21.15.142:0/3959453797 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x564e0d7203d0 con 0x564e0d8760e0 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 10 client.4689 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 5 client.4689 _closed_mds_session mds.0 seq 0 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 1 -- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8760e0 msgr2=0x564e0d86f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8760e0 0x564e0d86f0d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 10 client.4689 remove_session_caps mds.0 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 10 client.4689 kick_requests_closed for mds.0 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 10 client.4689 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 20 client.4689 trim_cache size 0 max 16384 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f0361e00640 10 client.4689 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 2 client.4689 unmounted. 2024-04-01T15:23:44.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 client.4689 shutdown 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 -- 172.21.15.142:0/3959453797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d880950 msgr2=0x564e0d7058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d880950 0x564e0d7058a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0354004510 tx=0x7f0354001dc0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 -- 172.21.15.142:0/3959453797 shutdown_connections 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d8760e0 0x564e0d86f0d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 0x564e0d74e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d713da0 0x564e0d748e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 --2- 172.21.15.142:0/3959453797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d880950 0x564e0d7058a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 -- 172.21.15.142:0/3959453797 >> 172.21.15.142:0/3959453797 conn(0x564e0d750560 msgr2=0x564e0d87dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.695+0000 7f036683d480 1 -- 172.21.15.142:0/3959453797 shutdown_connections 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.696+0000 7f036683d480 1 -- 172.21.15.142:0/3959453797 wait complete. 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.696+0000 7f036683d480 20 client.4689 trim_cache size 0 max 16384 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.696+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d713da0 0x564e0d86f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 0x564e0d7e0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8760e0 0x564e0d7daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f03300083a0 con 0x564e0d713da0 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d7dcac0 con 0x564e0d8760e0 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d71b680 con 0x564e0d871d50 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d713da0 0x564e0d86f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d713da0 0x564e0d86f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53010/0 (socket says 172.21.15.142:53010) 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.697+0000 7f0363200640 1 -- 172.21.15.142:0/1523200348 learned_addr learned my addr 172.21.15.142:0/1523200348 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f0363c00640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8760e0 0x564e0d7daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f035a800640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 0x564e0d7e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f0363200640 1 -- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 msgr2=0x564e0d7e0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f0363200640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d871d50 0x564e0d7e0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f0363200640 1 -- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8760e0 msgr2=0x564e0d7daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f0363200640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8760e0 0x564e0d7daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f0363200640 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d7096a0 con 0x564e0d713da0 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f0363c00640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d8760e0 0x564e0d7daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f0363200640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d713da0 0x564e0d86f0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0354008010 tx=0x564e0d7523c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad26513aa8c3a03 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.698+0000 7f0360a00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035401f2a0 con 0x564e0d713da0 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0354046470 con 0x564e0d713da0 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f036683d480 10 client.4692 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d71ec40 con 0x564e0d713da0 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0359400640 20 client.4692 tick 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0359400640 20 client.4692 collect_and_send_metrics 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0359400640 20 client.4692 collect_and_send_global_metrics 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0359400640 5 client.4692 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0359400640 20 client.4692 trim_cache size 0 max 16384 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0359400640 20 client.4692 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0354041070 con 0x564e0d713da0 2024-04-01T15:23:44.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f0354046bb0 con 0x564e0d713da0 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f0360a00640 1 client.4692 handle_mds_map epoch 8 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f036683d480 20 client.4692 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f036683d480 10 client.4692 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f036683d480 20 client.4692 mds is 0 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f036683d480 10 client.4692 _open_mds_session mds.0 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f036683d480 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d880950 0x564e0d7515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d705ff0 con 0x564e0d880950 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.699+0000 7f036683d480 10 client.4692 waiting for session to mds.0 to open 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.700+0000 7f035a800640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d880950 0x564e0d7515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.701+0000 7f035a800640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d880950 0x564e0d7515d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0c4908aeecc4fd0 server_cookie=19e13745ba80a7 in_seq=0 out_seq=0 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.701+0000 7f0360a00640 10 client.4692 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d705ff0 con 0x564e0d880950 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f0360a00640 10 client.4692 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f0360a00640 10 client.4692 renew_caps mds.0 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f033000a120 con 0x564e0d880950 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f0360a00640 10 client.4692 connect_mds_targets for mds.0 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f036683d480 10 client.4692 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f036683d480 20 client.4692 mds is 0 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f036683d480 10 client.4692 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f036683d480 20 client.4692 encode_cap_releases enter (req: 0x564e0d74e7e0, mds: 0) 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f036683d480 20 client.4692 send_request set sent_stamp to 2024-04-01T15:23:44.707327+0000 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f036683d480 10 client.4692 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.700613+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.700613+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d720220 con 0x564e0d880950 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f036683d480 20 client.4692 awaiting reply|forward|kick on 0x7ffc35e46a10 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f033000a120 con 0x564e0d880950 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.706+0000 7f0360a00640 10 client.4692 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f034c011040 con 0x564e0d880950 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 insert_trace from 2024-04-01T15:23:44.707327+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 features 0xffffffffffffffff 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 update_snap_trace len 70 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0x7f033000a340, nref now is 1 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 15 client.4692 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 15 client.4692 snapc 1=[] 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 put_snap_realm 0x1 0x7f033000a340 2 -> 1 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f033000a430) - ctime 2024-04-01T15:23:44.666993+0000 mtime 2024-04-01T15:23:44.666993+0000 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 dir hash is 2 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 12 client.4692 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 2 2024-04-01T15:23:44.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 12 client.4692 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=- has_dir_layout 0x7f033000a430) caps pAsLsXsFs 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0x7f033000a340, nref was 1 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0x7f033000a340, nref now is 2 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 15 client.4692 add_update_cap first one, opened snaprealm 0x7f033000a340 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 10 client.4692 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 put_snap_realm 0x1 0x7f033000a340 2 -> 1 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 handle_client_reply signalling caller 0x7ffc35e46a10 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 handle_client_reply awaiting kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 sendrecv kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 lat 0.001028 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 _ll_get 0x7f033000a430 0x1 -> 1 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 8 client.4692 _ll_create 0x1.head test_llreadvllwritevnullcontextfile45288 0666 578, uid 0, gid 0 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 10 client.4692 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a430) dn 'test_llreadvllwritevnullcontextfile45288' 2024-04-01T15:23:44.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a430); UserPerm(uid: 0, gid: 0) 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 10 client.4692 _getattr mask As issued=1 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 3 client.4692 may_create 0x7f033000a430 = 0 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 8 client.4692 _create(0x1 test_llreadvllwritevnullcontextfile45288, 0666) 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a430) name test_llreadvllwritevnullcontextfile45288 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 15 open_dir 0x564e0d751f50 on 0x7f033000a430 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 15 client.4692 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a430) 'test_llreadvllwritevnullcontextfile45288' dn 0x1.head["test_llreadvllwritevnullcontextfile45288"] (new dn) 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnullcontextfile45288 => 2940746491 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a430) is_hash=1 hash=2940746491 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 10 client.4692 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 mds is 0 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 10 client.4692 send_request rebuilding request 2 for mds.0 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 encode_cap_releases enter (req: 0x564e0d720550, mds: 0) 2024-04-01T15:23:44.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 encode_dentry_release enter(dn:0x564e0d6cddb0) 2024-04-01T15:23:44.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a430), req:0x564e0d720550 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-01T15:23:44.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 send_request set sent_stamp to 2024-04-01T15:23:44.708426+0000 2024-04-01T15:23:44.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 10 client.4692 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnullcontextfile45288 2024-04-01T15:23:44.708404+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnullcontextfile45288 2024-04-01T15:23:44.708404+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d720a40 con 0x564e0d880950 2024-04-01T15:23:44.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f036683d480 20 client.4692 awaiting reply|forward|kick on 0x7ffc35e46850 2024-04-01T15:23:44.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.707+0000 7f0360a00640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 861+0+0 (crc 0 0 0) 0x7f034c0077c0 con 0x564e0d880950 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 20 client.4692 handle_client_reply got a reply. Safe:1 tid 2 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 insert_trace from 2024-04-01T15:23:44.708426+0000 mds.0 is_target=1 is_dentry=1 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 features 0xffffffffffffffff 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 update_snap_trace len 70 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0x7f033000a340, nref was 1 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0x7f033000a340, nref now is 2 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 hrm is_target=1 is_dentry=1 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 update_inode_file_time 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) - ctime 2024-04-01T15:23:44.708404+0000 mtime 2024-04-01T15:23:44.708404+0000 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 12 client.4692 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 12 client.4692 add_update_inode adding 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=- objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) caps pAsxLsXsxFsxcrwb 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0x7f033000a340, nref was 2 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0x7f033000a340, nref now is 3 2024-04-01T15:23:44.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 15 client.4692 add_update_cap first one, opened snaprealm 0x7f033000a340 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 12 client.4692 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) caps pAsLsXs 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.666993+0000 ctime=2024-04-01T15:23:44.666993+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) pAsLsXs ctime 2024-04-01T15:23:44.708404+0000 mtime 2024-04-01T15:23:44.708404+0000 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 20 client.4692 dir hash is 2 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 12 client.4692 add_update_inode client inode change_attr: 2 , mds inodestat change_attr: 3 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 20 client.4692 got dirfrag map for 0x1 frag * to mds 0 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 12 client.4692 insert_dentry_inode 'test_llreadvllwritevnullcontextfile45288' vino 0x10000000001.head in dir 0x1.head dn 0x564e0d6cddb0 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 10 client.4692 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.712+0000 7f0360a00640 15 client.4692 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) 'test_llreadvllwritevnullcontextfile45288' to inode 0x7f033000aa10 dn 0x1.head["test_llreadvllwritevnullcontextfile45288"] (old dn) 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 20 client.4692 link inode 0x7f033000aa10 parents now 0x1.head["test_llreadvllwritevnullcontextfile45288"] 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 15 client.4692 update_dentry_lease 0x1.head["test_llreadvllwritevnullcontextfile45288"] lease(mask 7 dur 30000) from 2024-04-01T15:23:44.708426+0000 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 10 client.4692 got dentry lease on test_llreadvllwritevnullcontextfile45288 dur 30000ms ttl 2024-04-01T15:24:14.708426+0000 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 20 client.4692 put_snap_realm 0x1 0x7f033000a340 3 -> 2 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 20 client.4692 handle_client_reply signalling caller 0x7ffc35e46850 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 20 client.4692 handle_client_reply awaiting kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 20 client.4692 sendrecv kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 10 client.4692 delegated_inos: [] 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 10 client.4692 make_request created ino 0x10000000001 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 20 client.4692 make_request target is 0x10000000001.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 20 client.4692 lat 0.005727 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 10 break_deleg: breaking delegs on 0x10000000001.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 10 delegations_broken: delegations empty on 0x10000000001.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 10 client.4692 _create_fh 0x10000000001 mode 3 2024-04-01T15:23:44.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 20 client.4692 trim_cache size 1 max 16384 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 8 client.4692 create(#0x1/test_llreadvllwritevnullcontextfile45288, 0100666 layout 0 0 0) = 0 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 20 client.4692 _ll_create created = 1 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 8 client.4692 _ll_create 0x1.head test_llreadvllwritevnullcontextfile45288 0666 578 = 0 (0x564e0d720df0 10000000001) 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 20 client.4692 _ll_get 0x7f033000aa10 0x10000000001 -> 1 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 10 client.4692 fill_statx on 0x10000000001 snap/devhead mode 0100666 mtime 2024-04-01T15:23:44.708404+0000 ctime 2024-04-01T15:23:44.708404+0000 change_attr 0 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 10 client.4692 get_quota_root realm 0x1 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 10 client.4692 get_quota_root 0x10000000001.head -> 0x1.head 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 10 client.4692 cur file size is 0 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x564e0d7bff50 0x564e0d7c2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] -- osd_op(unknown.0.0:1 3.7 3:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x564e0d7c2950 con 0x564e0d7bff50 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] -- osd_op(unknown.0.0:2 3.7 3:e2e07930:::10000000001.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x564e0d7c31f0 con 0x564e0d7bff50 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0360a00640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.713+0000 7f0363c00640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x564e0d7bff50 0x564e0d7c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.714+0000 7f0360a00640 10 client.4692 ms_handle_connect on v2:172.21.15.142:6800/208376799 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.714+0000 7f0363c00640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x564e0d7bff50 0x564e0d7c2410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=510d99fee3bd5a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.714+0000 7f0363c00640 1 -- 172.21.15.142:0/1523200348 <== osd.3 v2:172.21.15.142:6800/208376799 1 ==== osd_op_reply(1 10000000001.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f035c05a040 con 0x564e0d7bff50 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f0363c00640 1 -- 172.21.15.142:0/1523200348 <== osd.3 v2:172.21.15.142:6800/208376799 2 ==== osd_op_reply(2 10000000001.00000000 [create] v22'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f035c05a040 con 0x564e0d7bff50 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 wanted_max_size 0 -> 14 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 get_caps 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 clear_suid_sgid 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10); UserPerm(uid: 0, gid: 0) defer 0 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 5 client.4692 get_cap_ref got first FILE_BUFFER ref on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 5 client.4692 get_cap_ref got first FILE_CACHE ref on 0x10000000001.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={4=0,1024=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 mark_caps_dirty 0x10000000001.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) - -> Fw 2024-04-01T15:23:44.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 cap_delay_requeue on 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 get_quota_root realm 0x1 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 get_quota_root 0x10000000001.head -> 0x1.head 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 7 client.4692 wrote to 14, extending file size 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 mark_caps_dirty 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) Fw -> Fw 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 cap_delay_requeue on 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 3 client.4692 pwritev(0x564e0d720df0, "...", 14, 0) = 14 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 get_caps 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 _read_async 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 0~14 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 3 client.4692 preadv(0x564e0d720df0, 0) = 14 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 3 client.4692 ll_release (fh)0x564e0d720df0 0x10000000001 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 8 client.4692 _release_fh 0x564e0d720df0 mode 3 on 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 _flush 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] -- osd_op(unknown.0.0:3 3.7 3:e2e07930:::10000000001.00000000:head [write 0~14 in=14b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x564e0d7c3630 con 0x564e0d7bff50 2024-04-01T15:23:44.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 check_caps on 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-01T15:23:44.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-01T15:23:44.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 delaying cap release 2024-04-01T15:23:44.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 cap_delay_requeue on 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 _release_fh 0x564e0d720df0 on inode 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) no async_err state 2024-04-01T15:23:44.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 3 client.4692 ll_unlink 0x1.head test_llreadvllwritevnullcontextfile45288 2024-04-01T15:23:44.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430); ; name test_llreadvllwritevnullcontextfile45288; UserPerm(uid: 0, gid: 0) 2024-04-01T15:23:44.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 _getattr mask As issued=1 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 3 client.4692 may_delete 0x7f033000a430 = 0 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 8 client.4692 _unlink(0x1 test_llreadvllwritevnullcontextfile45288 uid 0 gid 0) 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) name test_llreadvllwritevnullcontextfile45288 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 _lookup have 0x1.head["test_llreadvllwritevnullcontextfile45288"] from mds.0 ttl 2024-04-01T15:24:14.708426+0000 seq 2 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) test_llreadvllwritevnullcontextfile45288 = 0x10000000001.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 break_deleg: breaking delegs on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 delegations_broken: delegations empty on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnullcontextfile45288 => 2940746491 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) is_hash=1 hash=2940746491 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 choose_target_mds from dirfragtree hash 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 mds is 0 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 send_request rebuilding request 3 for mds.0 2024-04-01T15:23:44.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 encode_cap_releases enter (req: 0x564e0d7c3ac0, mds: 0) 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 encode_inode_release enter(in:0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10), req:0x564e0d7c3ac0 mds:0, drop:Lsx, unless:-, force:0) 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 encode_dentry_release enter(dn:0x564e0d6cddb0) 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430), req:0x564e0d7c3ac0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 send_request set sent_stamp to 2024-04-01T15:23:44.719622+0000 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 10 client.4692 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevnullcontextfile45288 2024-04-01T15:23:44.719601+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevnullcontextfile45288 2024-04-01T15:23:44.719601+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d7c3eb0 con 0x564e0d880950 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.718+0000 7f036683d480 20 client.4692 awaiting reply|forward|kick on 0x7ffc35e46a30 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 5 ==== client_caps(revoke ino 0x10000000001 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.708404+0000 ctime 2024-04-01T15:23:44.708404+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f034c0079b0 con 0x564e0d880950 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 5 client.4692 set_cap_epoch_barrier epoch = 20 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 client.4692 mds.0 seq now 1 2024-04-01T15:23:44.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 5 client.4692 handle_cap_grant on in 0x10000000001 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 client.4692 update_inode_file_time 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) pAsxXsxFsxcrwb ctime 2024-04-01T15:23:44.708404+0000 mtime 2024-04-01T15:23:44.708404+0000 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 client.4692 revocation of AxXx 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 client.4692 check_caps on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 client.4692 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 client.4692 completed revocation of AxXx 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 client.4692 mark_caps_flushing Fw 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 mark_caps_clean 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 client.4692 send_cap 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsLsxXsFsxcrwbl held pAsxXsxFsxcrwb revoking AxXx dropping - 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 15 client.4692 auth cap, requesting max_size 14 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_caps(update ino 0x10000000001 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 14/14 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.719451+0000 ctime 2024-04-01T15:23:44.719451+0000 change_attr 1) -- 0x7f033000aff0 con 0x564e0d880950 2024-04-01T15:23:44.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.719+0000 7f0360a00640 10 client.4692 handle_cap_grant calling signal_caps_inode 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0363c00640 1 -- 172.21.15.142:0/1523200348 <== osd.3 v2:172.21.15.142:6800/208376799 3 ==== osd_op_reply(3 10000000001.00000000 [write 0~14] v22'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f035c05a040 con 0x564e0d7bff50 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f035b400640 10 client.4692 _flushed 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f035b400640 5 client.4692 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f035b400640 5 client.4692 put_cap_ref dropped last FILE_CACHE ref on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f035b400640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) n = 2 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f035b400640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile45288"] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 6 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 509+0+0 (crc 0 0 0) 0x7f034c007d10 con 0x564e0d880950 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 handle_client_reply got a reply. Safe:0 tid 3 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 insert_trace from 2024-04-01T15:23:44.719622+0000 mds.0 is_target=0 is_dentry=1 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 features 0xffffffffffffffff 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 update_snap_trace len 70 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0x7f033000a340, nref was 2 2024-04-01T15:23:44.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 get_snap_realm 0x1 0x7f033000a340, nref now is 3 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 hrm is_target=0 is_dentry=1 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 12 client.4692 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) caps pAsLsXs 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.708404+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) pAsLsXs ctime 2024-04-01T15:23:44.719601+0000 mtime 2024-04-01T15:23:44.708404+0000 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 dir hash is 2 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 12 client.4692 add_update_inode client inode change_attr: 3 , mds inodestat change_attr: 4 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 got dirfrag map for 0x1 frag * to mds 0 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 15 client.4692 unlink dir 0x7f033000a430 'test_llreadvllwritevnullcontextfile45288' dn 0x564e0d6cddb0 inode 0x7f033000aa10 2024-04-01T15:23:44.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 unlink inode 0x7f033000aa10 parents now 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 15 client.4692 update_dentry_lease 0x1.head["test_llreadvllwritevnullcontextfile45288"] lease(mask 3 dur 30000) from 2024-04-01T15:23:44.719622+0000 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 got dentry lease on test_llreadvllwritevnullcontextfile45288 dur 30000ms ttl 2024-04-01T15:24:14.719622+0000 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 put_snap_realm 0x1 0x7f033000a340 3 -> 2 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 handle_client_reply signalling caller 0x7ffc35e46a30 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 handle_client_reply awaiting kickback on tid 3 0x7f03609fde80 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 20 client.4692 sendrecv kickback on tid 3 0x7f03609fde80 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 20 client.4692 lat 0.003844 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 20 client.4692 trim_cache size 1 max 16384 2024-04-01T15:23:44.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 8 client.4692 unlink(#0x1/test_llreadvllwritevnullcontextfile45288) = 0 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 2 client.4692 unmount 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 2 client.4692 unmounting 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_flushmdlog) -- 0x564e0d7cf860 con 0x564e0d880950 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 10 client.4692 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 unmounting: trim pass, size was 1+2 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 20 client.4692 trim_cache size 1 max 16384 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f0360a00640 10 client.4692 unmounting: trim pass, size still 1+2 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.722+0000 7f036683d480 10 client.4692 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 7 ==== client_caps(grant ino 0x10000000001 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=LsFxcb follows 0 size 14/4194304 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.719451+0000 ctime 2024-04-01T15:23:44.719601+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f033000aff0 con 0x564e0d880950 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 mds.0 seq now 2 2024-04-01T15:23:44.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 5 client.4692 handle_cap_grant on in 0x10000000001 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFsxcrwb 2024-04-01T15:23:44.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 update_inode_file_time 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719451+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) pAsXsFsxcrwb ctime 2024-04-01T15:23:44.719601+0000 mtime 2024-04-01T15:23:44.719451+0000 2024-04-01T15:23:44.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 grant, new caps are Ls 2024-04-01T15:23:44.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 handle_cap_grant calling signal_caps_inode 2024-04-01T15:23:44.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 5 client.4692 _try_to_trim_inode in 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) 2024-04-01T15:23:44.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 unmounting: trim pass, size was 1+2 2024-04-01T15:23:44.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 20 client.4692 trim_cache size 1 max 16384 2024-04-01T15:23:44.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 unmounting: trim pass, size still 1+2 2024-04-01T15:23:44.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 8 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f034c03e5d0 con 0x564e0d880950 2024-04-01T15:23:44.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 20 client.4692 handle_client_reply got a reply. Safe:1 tid 3 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 insert_trace from 2024-04-01T15:23:44.719622+0000 mds.0 is_target=0 is_dentry=0 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 insert_trace -- already got unsafe; ignoring 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 unmounting: trim pass, size was 1+2 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 20 client.4692 trim_cache size 1 max 16384 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 15 client.4692 trim_dentry unlinking dn test_llreadvllwritevnullcontextfile45288 in dir 0x1 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 15 client.4692 unlink dir 0x7f033000a430 'test_llreadvllwritevnullcontextfile45288' dn 0x564e0d6cddb0 inode 0 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 15 client.4692 unlink removing 'test_llreadvllwritevnullcontextfile45288' dn 0x564e0d6cddb0 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 15 client.4692 close_dir dir 0x564e0d751f50 on 0x7f033000a430 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 unmounting: trim pass, cache shrank, poking unmount() 2024-04-01T15:23:44.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 _ll_drop_pins 2024-04-01T15:23:44.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 _ll_put 0x7f033000aa10 0x10000000001 1 -> 0 2024-04-01T15:23:44.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 _ll_put 0x7f033000a430 0x1 2 -> 0 2024-04-01T15:23:44.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 _release 0x10000000001.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 _invalidate_inode_cache 0x10000000001.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f033000aa10) 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 _flush 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 nothing to flush 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 nothing to flush 2024-04-01T15:23:44.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 1 2024-04-01T15:23:44.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 flush_caps_sync 2024-04-01T15:23:44.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 wait_sync_caps want 2 (last is 2, 1 total flushing) 2024-04-01T15:23:44.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 9 ==== client_caps(flush_ack ino 0x10000000001 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f034c03e930 con 0x564e0d880950 2024-04-01T15:23:44.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 waiting on mds.0 tid 2 (want 2) 2024-04-01T15:23:44.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 mds.0 seq now 3 2024-04-01T15:23:44.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 5 client.4692 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) with Fw 2024-04-01T15:23:44.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 5 client.4692 flushing_caps Fw -> - 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) !flushing 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 handle_cap_flush_ack calling signal_caps_inode 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) n = 1 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 trim_cache size 0 max 16384 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) n = 11 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 15 client.4692 remove_cap last one, closing snaprealm 0x7f033000a340 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_snap_realm 0x1 0x7f033000a340 2 -> 1 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.708404+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=- COMPLETE has_dir_layout 0x7f033000a430) 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 _put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) n = 18 2024-04-01T15:23:44.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 remove_cap mds.0 on 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 15 client.4692 remove_cap last one, closing snaprealm 0x7f033000a340 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 20 client.4692 put_snap_realm 0x1 0x7f033000a340 1 -> 0 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 10 client.4692 _put_inode deleting 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-01T15:23:44.708404+0000 mtime=2024-04-01T15:23:44.719451+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=1 caps=- objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000aa10) 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 2 client.4692 _close_mds_session mds.0 seq 3 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close seq 3) -- 0x564e0d7bf590 con 0x564e0d880950 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f036683d480 2 client.4692 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 20 client.4692 trim_cache size 0 max 16384 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.731+0000 7f0360a00640 10 client.4692 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 <== mds.0 v2:172.21.15.179:6834/1191595510 10 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x564e0d7bf590 con 0x564e0d880950 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 10 client.4692 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 5 client.4692 _closed_mds_session mds.0 seq 3 2024-04-01T15:23:44.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 1 -- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d880950 msgr2=0x564e0d7515d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d880950 0x564e0d7515d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 10 client.4692 remove_session_caps mds.0 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 10 client.4692 kick_requests_closed for mds.0 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 10 client.4692 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 20 client.4692 trim_cache size 0 max 16384 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f0360a00640 10 client.4692 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f036683d480 2 client.4692 unmounted. 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.735+0000 7f036683d480 1 client.4692 shutdown 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x564e0d7bff50 msgr2=0x564e0d7c2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f036683d480 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x564e0d7bff50 0x564e0d7c2410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d713da0 msgr2=0x564e0d86f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f036683d480 1 --2- 172.21.15.142:0/1523200348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d713da0 0x564e0d86f0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0354008010 tx=0x564e0d7523c0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f0363c00640 1 -- 172.21.15.142:0/1523200348 reap_dead start 2024-04-01T15:23:44.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 shutdown_connections 2024-04-01T15:23:44.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 >> 172.21.15.142:0/1523200348 conn(0x564e0d750560 msgr2=0x564e0d87dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 shutdown_connections 2024-04-01T15:23:44.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f036683d480 1 -- 172.21.15.142:0/1523200348 wait complete. 2024-04-01T15:23:44.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.736+0000 7f036683d480 20 client.4692 trim_cache size 0 max 16384 2024-04-01T15:23:44.760 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestClient.LlreadvLlwritevNullContext (56 ms) 2024-04-01T15:23:44.760 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestClient.LlreadvLlwritevOPathFileHandle 2024-04-01T15:23:44.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.737+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.738+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.738+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.738+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d86f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.738+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d74e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.738+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0330004e50 con 0x564e0d876090 2024-04-01T15:23:44.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.738+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d750230 con 0x564e0d879a90 2024-04-01T15:23:44.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.738+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d7503e0 con 0x564e0d71f2f0 2024-04-01T15:23:44.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d74e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d74e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53024/0 (socket says 172.21.15.142:53024) 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363c00640 1 -- 172.21.15.142:0/218060657 learned_addr learned my addr 172.21.15.142:0/218060657 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363200640 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f035a800640 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d86f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363c00640 1 -- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 msgr2=0x564e0d7daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363c00640 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363c00640 1 -- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 msgr2=0x564e0d86f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363c00640 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d86f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363c00640 1 -- 172.21.15.142:0/218060657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d71ee10 con 0x564e0d876090 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.739+0000 7f0363200640 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0363c00640 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d74e690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f035c044880 tx=0x7f035c04c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e5d79af3c7ba90 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0361e00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c08e060 con 0x564e0d876090 2024-04-01T15:23:44.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f035c052440 con 0x564e0d876090 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f036683d480 10 client.4695 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f036683d480 1 -- 172.21.15.142:0/218060657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d7cf1e0 con 0x564e0d876090 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0358a00640 20 client.4695 tick 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0358a00640 20 client.4695 collect_and_send_metrics 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0358a00640 20 client.4695 collect_and_send_global_metrics 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0358a00640 5 client.4695 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0358a00640 20 client.4695 trim_cache size 0 max 16384 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0358a00640 20 client.4695 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.740+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035c0152b0 con 0x564e0d876090 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f035c076040 con 0x564e0d876090 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f0361e00640 1 client.4695 handle_mds_map epoch 8 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f036683d480 20 client.4695 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f036683d480 10 client.4695 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f036683d480 20 client.4695 mds is 0 2024-04-01T15:23:44.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f036683d480 10 client.4695 _open_mds_session mds.0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f036683d480 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d871d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f036683d480 1 -- 172.21.15.142:0/218060657 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f036683d480 10 client.4695 waiting for session to mds.0 to open 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.741+0000 7f0363200640 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d871d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.742+0000 7f0363200640 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d871d50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=826588afa650331 server_cookie=c80140117428d734 in_seq=0 out_seq=0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.742+0000 7f0361e00640 10 client.4695 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 renew_caps mds.0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f033000a500 con 0x564e0d879fc0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 connect_mds_targets for mds.0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f036683d480 10 client.4695 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f036683d480 20 client.4695 mds is 0 2024-04-01T15:23:44.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f036683d480 10 client.4695 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f036683d480 20 client.4695 encode_cap_releases enter (req: 0x564e0d74b390, mds: 0) 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f036683d480 20 client.4695 send_request set sent_stamp to 2024-04-01T15:23:44.750737+0000 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f036683d480 10 client.4695 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.742224+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f036683d480 1 -- 172.21.15.142:0/218060657 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.742224+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d7e0100 con 0x564e0d879fc0 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f036683d480 20 client.4695 awaiting reply|forward|kick on 0x7ffc35e46ce0 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f033000a500 con 0x564e0d879fc0 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f035401e040 con 0x564e0d879fc0 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 insert_trace from 2024-04-01T15:23:44.750737+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 features 0xffffffffffffffff 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 update_snap_trace len 70 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 get_snap_realm 0x1 0x7f033000a720, nref now is 1 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 15 client.4695 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 15 client.4695 snapc 1=[] 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 put_snap_realm 0x1 0x7f033000a720 2 -> 1 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f033000a810) - ctime 2024-04-01T15:23:44.719601+0000 mtime 2024-04-01T15:23:44.719601+0000 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 dir hash is 2 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 12 client.4695 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 4 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 12 client.4695 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=- has_dir_layout 0x7f033000a810) caps pAsLsXsFs 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 get_snap_realm 0x1 0x7f033000a720, nref was 1 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 get_snap_realm 0x1 0x7f033000a720, nref now is 2 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 15 client.4695 add_update_cap first one, opened snaprealm 0x7f033000a720 2024-04-01T15:23:44.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000a810) 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 10 client.4695 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000a810) 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 put_snap_realm 0x1 0x7f033000a720 2 -> 1 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 handle_client_reply signalling caller 0x7ffc35e46ce0 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.750+0000 7f0361e00640 20 client.4695 handle_client_reply awaiting kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 sendrecv kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 lat 0.001337 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 _ll_get 0x7f033000a810 0x1 -> 1 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 2 client.4695 unmount 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f0361e00640 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) n = 1 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f0361e00640 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) n = 1 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f0361e00640 10 client.4695 unmounting: trim pass, size was 0+1 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f0361e00640 20 client.4695 trim_cache size 0 max 16384 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f0361e00640 10 client.4695 unmounting: trim pass, size still 0+1 2024-04-01T15:23:44.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 2 client.4695 unmounting 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) n = 1 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) n = 1 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 10 client.4695 _ll_drop_pins 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 _ll_put 0x7f033000a810 0x1 1 -> 0 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) n = 1 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) n = 1 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 10 client.4695 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 10 client.4695 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 10 client.4695 nothing to flush 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) n = 1 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) n = 1 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 10 client.4695 flush_caps_sync 2024-04-01T15:23:44.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 10 client.4695 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 trim_cache size 0 max 16384 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 10 client.4695 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) n = 8 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 10 client.4695 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a810) 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 15 client.4695 remove_cap last one, closing snaprealm 0x7f033000a720 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 20 client.4695 put_snap_realm 0x1 0x7f033000a720 1 -> 0 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 10 client.4695 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=- COMPLETE has_dir_layout 0x7f033000a810) 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 2 client.4695 _close_mds_session mds.0 seq 0 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 1 -- 172.21.15.142:0/218060657 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close) -- 0x564e0d87a3a0 con 0x564e0d879fc0 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.751+0000 7f036683d480 2 client.4695 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x564e0d87a3a0 con 0x564e0d879fc0 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 10 client.4695 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 5 client.4695 _closed_mds_session mds.0 seq 0 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 1 -- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 msgr2=0x564e0d871d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d871d50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 10 client.4695 remove_session_caps mds.0 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 10 client.4695 kick_requests_closed for mds.0 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 10 client.4695 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 20 client.4695 trim_cache size 0 max 16384 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f0361e00640 10 client.4695 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f036683d480 2 client.4695 unmounted. 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.754+0000 7f036683d480 1 client.4695 shutdown 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 -- 172.21.15.142:0/218060657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 msgr2=0x564e0d74e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d74e690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f035c044880 tx=0x7f035c04c070 comp rx=0 tx=0).stop 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 -- 172.21.15.142:0/218060657 shutdown_connections 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d871d50 unknown :-1 s=CLOSED pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d74e690 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d86f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 --2- 172.21.15.142:0/218060657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 -- 172.21.15.142:0/218060657 >> 172.21.15.142:0/218060657 conn(0x564e0d750560 msgr2=0x564e0d7515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 -- 172.21.15.142:0/218060657 shutdown_connections 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 1 -- 172.21.15.142:0/218060657 wait complete. 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.755+0000 7f036683d480 20 client.4695 trim_cache size 0 max 16384 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.756+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.757+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.757+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.757+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d876090 0x564e0d86f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.757+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d879a90 0x564e0d74b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.757+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0330008e40 con 0x564e0d879a90 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.757+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d7cbfd0 con 0x564e0d876090 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.757+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d7cc150 con 0x564e0d71f2f0 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d879a90 0x564e0d74b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d879a90 0x564e0d74b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53038/0 (socket says 172.21.15.142:53038) 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363c00640 1 -- 172.21.15.142:0/2555715412 learned_addr learned my addr 172.21.15.142:0/2555715412 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363200640 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f035a800640 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d876090 0x564e0d86f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363c00640 1 -- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 msgr2=0x564e0d7dcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363c00640 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363c00640 1 -- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d876090 msgr2=0x564e0d86f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363c00640 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d876090 0x564e0d86f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363c00640 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d706d20 con 0x564e0d879a90 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363200640 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0363c00640 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d879a90 0x564e0d74b390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f035c044880 tx=0x7f035c078000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6797feaa39424da5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.758+0000 7f0360a00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c057040 con 0x564e0d879a90 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f035c052440 con 0x564e0d879a90 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f036683d480 10 client.4698 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d7c3020 con 0x564e0d879a90 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0359400640 20 client.4698 tick 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0359400640 20 client.4698 collect_and_send_metrics 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0359400640 20 client.4698 collect_and_send_global_metrics 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0359400640 5 client.4698 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0359400640 20 client.4698 trim_cache size 0 max 16384 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0359400640 20 client.4698 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035c009690 con 0x564e0d879a90 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f035c076030 con 0x564e0d879a90 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f0360a00640 1 client.4698 handle_mds_map epoch 8 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f036683d480 20 client.4698 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f036683d480 10 client.4698 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f036683d480 20 client.4698 mds is 0 2024-04-01T15:23:44.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f036683d480 10 client.4698 _open_mds_session mds.0 2024-04-01T15:23:44.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f036683d480 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.759+0000 7f036683d480 10 client.4698 waiting for session to mds.0 to open 2024-04-01T15:23:44.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.760+0000 7f0363200640 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.761+0000 7f0363200640 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ddfbc77801ffe1d server_cookie=f753e0fb6a638b08 in_seq=0 out_seq=0 2024-04-01T15:23:44.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.761+0000 7f0360a00640 10 client.4698 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f0360a00640 10 client.4698 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f0360a00640 10 client.4698 renew_caps mds.0 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f033000a520 con 0x564e0d879fc0 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f0360a00640 10 client.4698 connect_mds_targets for mds.0 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f036683d480 10 client.4698 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f036683d480 20 client.4698 mds is 0 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f036683d480 10 client.4698 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f036683d480 20 client.4698 encode_cap_releases enter (req: 0x564e0d74e460, mds: 0) 2024-04-01T15:23:44.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f036683d480 20 client.4698 send_request set sent_stamp to 2024-04-01T15:23:44.769538+0000 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f036683d480 10 client.4698 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.760848+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.760848+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d74e7d0 con 0x564e0d879fc0 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f036683d480 20 client.4698 awaiting reply|forward|kick on 0x7ffc35e469f0 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f033000a520 con 0x564e0d879fc0 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.768+0000 7f0360a00640 10 client.4698 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f035401e040 con 0x564e0d879fc0 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 insert_trace from 2024-04-01T15:23:44.769538+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 features 0xffffffffffffffff 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 update_snap_trace len 70 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0x7f033000a740, nref now is 1 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 15 client.4698 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 15 client.4698 snapc 1=[] 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 put_snap_realm 0x1 0x7f033000a740 2 -> 1 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f033000a830) - ctime 2024-04-01T15:23:44.719601+0000 mtime 2024-04-01T15:23:44.719601+0000 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 dir hash is 2 2024-04-01T15:23:44.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 12 client.4698 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 4 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 12 client.4698 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=- has_dir_layout 0x7f033000a830) caps pAsLsXsFs 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0x7f033000a740, nref was 1 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0x7f033000a740, nref now is 2 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 15 client.4698 add_update_cap first one, opened snaprealm 0x7f033000a740 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 10 client.4698 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 put_snap_realm 0x1 0x7f033000a740 2 -> 1 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 handle_client_reply signalling caller 0x7ffc35e469f0 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 handle_client_reply awaiting kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f036683d480 20 client.4698 sendrecv kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f036683d480 20 client.4698 lat 0.001437 2024-04-01T15:23:44.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f036683d480 20 client.4698 _ll_get 0x7f033000a830 0x1 -> 1 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.769+0000 7f0360a00640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 8 client.4698 _ll_create 0x1.head test_llreadvllwritevopathfilehandlefile45288 0666 66, uid 0, gid 0 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 10 client.4698 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830) dn 'test_llreadvllwritevopathfilehandlefile45288' 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830); UserPerm(uid: 0, gid: 0) 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 10 client.4698 _getattr mask As issued=1 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 3 client.4698 may_create 0x7f033000a830 = 0 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 8 client.4698 _create(0x1 test_llreadvllwritevopathfilehandlefile45288, 0666) 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830) name test_llreadvllwritevopathfilehandlefile45288 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 15 open_dir 0x564e0d752500 on 0x7f033000a830 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 15 client.4698 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830) 'test_llreadvllwritevopathfilehandlefile45288' dn 0x1.head["test_llreadvllwritevopathfilehandlefile45288"] (new dn) 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 choose_target_mds inode dir hash is 2 on test_llreadvllwritevopathfilehandlefile45288 => 2549572757 2024-04-01T15:23:44.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830) is_hash=1 hash=2549572757 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 10 client.4698 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 mds is 0 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 10 client.4698 send_request rebuilding request 2 for mds.0 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 encode_cap_releases enter (req: 0x564e0d74e7d0, mds: 0) 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 encode_dentry_release enter(dn:0x7f034800d9f0) 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000a830), req:0x564e0d74e7d0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 send_request set sent_stamp to 2024-04-01T15:23:44.771132+0000 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 10 client.4698 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevopathfilehandlefile45288 2024-04-01T15:23:44.771110+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevopathfilehandlefile45288 2024-04-01T15:23:44.771110+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d7e0100 con 0x564e0d879fc0 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.770+0000 7f036683d480 20 client.4698 awaiting reply|forward|kick on 0x7ffc35e46830 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 865+0+0 (crc 0 0 0) 0x7f0354000fb0 con 0x564e0d879fc0 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 2 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 insert_trace from 2024-04-01T15:23:44.771132+0000 mds.0 is_target=1 is_dentry=1 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 features 0xffffffffffffffff 2024-04-01T15:23:44.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 update_snap_trace len 70 2024-04-01T15:23:44.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0x7f033000a740, nref was 1 2024-04-01T15:23:44.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0x7f033000a740, nref now is 2 2024-04-01T15:23:44.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-01T15:23:44.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 hrm is_target=1 is_dentry=1 2024-04-01T15:23:44.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 update_inode_file_time 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) - ctime 2024-04-01T15:23:44.771110+0000 mtime 2024-04-01T15:23:44.771110+0000 2024-04-01T15:23:44.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 12 client.4698 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 12 client.4698 add_update_inode adding 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=- objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) caps pAsxLsXsxFsxcrwb 2024-04-01T15:23:44.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0x7f033000a740, nref was 2 2024-04-01T15:23:44.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0x7f033000a740, nref now is 3 2024-04-01T15:23:44.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 15 client.4698 add_update_cap first one, opened snaprealm 0x7f033000a740 2024-04-01T15:23:44.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) 2024-04-01T15:23:44.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 12 client.4698 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) caps pAsLsXs 2024-04-01T15:23:44.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.719601+0000 ctime=2024-04-01T15:23:44.719601+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) pAsLsXs ctime 2024-04-01T15:23:44.771110+0000 mtime 2024-04-01T15:23:44.771110+0000 2024-04-01T15:23:44.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 dir hash is 2 2024-04-01T15:23:44.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 12 client.4698 add_update_inode client inode change_attr: 4 , mds inodestat change_attr: 5 2024-04-01T15:23:44.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 got dirfrag map for 0x1 frag * to mds 0 2024-04-01T15:23:44.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 12 client.4698 insert_dentry_inode 'test_llreadvllwritevopathfilehandlefile45288' vino 0x10000000002.head in dir 0x1.head dn 0x7f034800d9f0 2024-04-01T15:23:44.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 15 client.4698 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) 'test_llreadvllwritevopathfilehandlefile45288' to inode 0x7f033000ae10 dn 0x1.head["test_llreadvllwritevopathfilehandlefile45288"] (old dn) 2024-04-01T15:23:44.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 link inode 0x7f033000ae10 parents now 0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 2024-04-01T15:23:44.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 15 client.4698 update_dentry_lease 0x1.head["test_llreadvllwritevopathfilehandlefile45288"] lease(mask 7 dur 30000) from 2024-04-01T15:23:44.771132+0000 2024-04-01T15:23:44.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 10 client.4698 got dentry lease on test_llreadvllwritevopathfilehandlefile45288 dur 30000ms ttl 2024-04-01T15:24:14.771132+0000 2024-04-01T15:23:44.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 put_snap_realm 0x1 0x7f033000a740 3 -> 2 2024-04-01T15:23:44.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 handle_client_reply signalling caller 0x7ffc35e46830 2024-04-01T15:23:44.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 handle_client_reply awaiting kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 sendrecv kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 delegated_inos: [] 2024-04-01T15:23:44.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 make_request created ino 0x10000000002 2024-04-01T15:23:44.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 make_request target is 0x10000000002.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) 2024-04-01T15:23:44.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 lat 0.006192 2024-04-01T15:23:44.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 break_deleg: breaking delegs on 0x10000000002.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 delegations_broken: delegations empty on 0x10000000002.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 _create_fh 0x10000000002 mode 3 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 trim_cache size 1 max 16384 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 8 client.4698 create(#0x1/test_llreadvllwritevopathfilehandlefile45288, 0100666 layout 0 0 0) = 0 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 _ll_create created = 1 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 8 client.4698 _ll_create 0x1.head test_llreadvllwritevopathfilehandlefile45288 0666 66 = 0 (0x564e0d7e0100 10000000002) 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 _ll_get 0x7f033000ae10 0x10000000002 -> 1 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 fill_statx on 0x10000000002 snap/devhead mode 0100666 mtime 2024-04-01T15:23:44.771110+0000 ctime 2024-04-01T15:23:44.771110+0000 change_attr 0 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 3 client.4698 ll_release (fh)0x564e0d7e0100 0x10000000002 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 8 client.4698 _release_fh 0x564e0d7e0100 mode 3 on 0x10000000002.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) 2024-04-01T15:23:44.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 _flush 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 nothing to flush 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 check_caps on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 delaying cap release 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 cap_delay_requeue on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 _release_fh 0x564e0d7e0100 on inode 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) no async_err state 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 3 client.4698 ll_unlink 0x1.head test_llreadvllwritevopathfilehandlefile45288 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830); ; name test_llreadvllwritevopathfilehandlefile45288; UserPerm(uid: 0, gid: 0) 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 _getattr mask As issued=1 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 3 client.4698 may_delete 0x7f033000a830 = 0 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 8 client.4698 _unlink(0x1 test_llreadvllwritevopathfilehandlefile45288 uid 0 gid 0) 2024-04-01T15:23:44.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) name test_llreadvllwritevopathfilehandlefile45288 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 _lookup have 0x1.head["test_llreadvllwritevopathfilehandlefile45288"] from mds.0 ttl 2024-04-01T15:24:14.771132+0000 seq 2 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) test_llreadvllwritevopathfilehandlefile45288 = 0x10000000002.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 break_deleg: breaking delegs on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 delegations_broken: delegations empty on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 choose_target_mds inode dir hash is 2 on test_llreadvllwritevopathfilehandlefile45288 => 2549572757 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) is_hash=1 hash=2549572757 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 choose_target_mds from dirfragtree hash 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 mds is 0 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 send_request rebuilding request 3 for mds.0 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 encode_cap_releases enter (req: 0x564e0d7e0510, mds: 0) 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 encode_inode_release enter(in:0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10), req:0x564e0d7e0510 mds:0, drop:Lsx, unless:-, force:0) 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 encode_dentry_release enter(dn:0x7f034800d9f0) 2024-04-01T15:23:44.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830), req:0x564e0d7e0510 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 send_request set sent_stamp to 2024-04-01T15:23:44.777451+0000 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 10 client.4698 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevopathfilehandlefile45288 2024-04-01T15:23:44.777429+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevopathfilehandlefile45288 2024-04-01T15:23:44.777429+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d7e0880 con 0x564e0d879fc0 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f036683d480 20 client.4698 awaiting reply|forward|kick on 0x7ffc35e46a10 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.776+0000 7f0360a00640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 5 ==== client_caps(revoke ino 0x10000000002 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.771110+0000 ctime 2024-04-01T15:23:44.771110+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f0354013050 con 0x564e0d879fc0 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 5 client.4698 set_cap_epoch_barrier epoch = 20 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 10 client.4698 mds.0 seq now 1 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 5 client.4698 handle_cap_grant on in 0x10000000002 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 10 client.4698 update_inode_file_time 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) pAsxXsxFsxcrwb ctime 2024-04-01T15:23:44.771110+0000 mtime 2024-04-01T15:23:44.771110+0000 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 10 client.4698 revocation of AxXx 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 10 client.4698 check_caps on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) wanted - used - issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-01T15:23:44.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 10 client.4698 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 10 client.4698 completed revocation of AxXx 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 10 client.4698 send_cap 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile45288"] 0x7f033000ae10) mds.0 seq 2 used - want - flush - retain pAsLsXsFs held pAsxXsxFsxcrwb revoking AxXx dropping Fxcrwb 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 15 client.4698 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_caps(update ino 0x10000000002 1 seq 2 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.771110+0000 ctime 2024-04-01T15:23:44.771110+0000 change_attr 0) -- 0x7f033000b3f0 con 0x564e0d879fc0 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.777+0000 7f0360a00640 10 client.4698 handle_cap_grant calling signal_caps_inode 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 6 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 513+0+0 (crc 0 0 0) 0x7f0354017250 con 0x564e0d879fc0 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 handle_client_reply got a reply. Safe:0 tid 3 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 insert_trace from 2024-04-01T15:23:44.777451+0000 mds.0 is_target=0 is_dentry=1 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 features 0xffffffffffffffff 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 update_snap_trace len 70 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0x7f033000a740, nref was 2 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 get_snap_realm 0x1 0x7f033000a740, nref now is 3 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 hrm is_target=0 is_dentry=1 2024-04-01T15:23:44.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 12 client.4698 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) caps pAsLsXs 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) pAsLsXs ctime 2024-04-01T15:23:44.777429+0000 mtime 2024-04-01T15:23:44.771110+0000 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 dir hash is 2 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 12 client.4698 add_update_inode client inode change_attr: 5 , mds inodestat change_attr: 6 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 got dirfrag map for 0x1 frag * to mds 0 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 15 client.4698 unlink dir 0x7f033000a830 'test_llreadvllwritevopathfilehandlefile45288' dn 0x7f034800d9f0 inode 0x7f033000ae10 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 unlink inode 0x7f033000ae10 parents now 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 15 client.4698 update_dentry_lease 0x1.head["test_llreadvllwritevopathfilehandlefile45288"] lease(mask 3 dur 30000) from 2024-04-01T15:23:44.777451+0000 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 got dentry lease on test_llreadvllwritevopathfilehandlefile45288 dur 30000ms ttl 2024-04-01T15:24:14.777451+0000 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 put_snap_realm 0x1 0x7f033000a740 3 -> 2 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 handle_client_reply signalling caller 0x7ffc35e46a10 2024-04-01T15:23:44.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 handle_client_reply awaiting kickback on tid 3 0x7f03609fde80 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 20 client.4698 sendrecv kickback on tid 3 0x7f03609fde80 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 20 client.4698 lat 0.003098 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 20 client.4698 trim_cache size 1 max 16384 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 8 client.4698 unlink(#0x1/test_llreadvllwritevopathfilehandlefile45288) = 0 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 2 client.4698 unmount 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 2 client.4698 unmounting 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_flushmdlog) -- 0x564e0d7e0880 con 0x564e0d879fc0 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 10 client.4698 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 unmounting: trim pass, size was 1+2 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 20 client.4698 trim_cache size 1 max 16384 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f0360a00640 10 client.4698 unmounting: trim pass, size still 1+2 2024-04-01T15:23:44.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.779+0000 7f036683d480 10 client.4698 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 7 ==== client_caps(grant ino 0x10000000002 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.771110+0000 ctime 2024-04-01T15:23:44.777429+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f033000b3f0 con 0x564e0d879fc0 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 mds.0 seq now 2 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 5 client.4698 handle_cap_grant on in 0x10000000002 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFs 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 update_inode_file_time 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.771110+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) pAsXsFs ctime 2024-04-01T15:23:44.777429+0000 mtime 2024-04-01T15:23:44.771110+0000 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 max_size 4194304 -> 0 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 grant, new caps are LsFxcrwb 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 handle_cap_grant calling signal_caps_inode 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 5 client.4698 _try_to_trim_inode in 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 unmounting: trim pass, size was 1+2 2024-04-01T15:23:44.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 20 client.4698 trim_cache size 1 max 16384 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 unmounting: trim pass, size still 1+2 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 8 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f0354017440 con 0x564e0d879fc0 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 3 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 insert_trace from 2024-04-01T15:23:44.777451+0000 mds.0 is_target=0 is_dentry=0 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 insert_trace -- already got unsafe; ignoring 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 unmounting: trim pass, size was 1+2 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 20 client.4698 trim_cache size 1 max 16384 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 15 client.4698 trim_dentry unlinking dn test_llreadvllwritevopathfilehandlefile45288 in dir 0x1 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 15 client.4698 unlink dir 0x7f033000a830 'test_llreadvllwritevopathfilehandlefile45288' dn 0x7f034800d9f0 inode 0 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 15 client.4698 unlink removing 'test_llreadvllwritevopathfilehandlefile45288' dn 0x7f034800d9f0 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 15 client.4698 close_dir dir 0x564e0d752500 on 0x7f033000a830 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 unmounting: trim pass, cache shrank, poking unmount() 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 _ll_drop_pins 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 _ll_put 0x7f033000ae10 0x10000000002 1 -> 0 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 _ll_put 0x7f033000a830 0x1 2 -> 0 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 _release 0x10000000002.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 _invalidate_inode_cache 0x10000000002.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 _flush 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 nothing to flush 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 nothing to flush 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 9 ==== client_caps(grant ino 0x10000000002 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-01T15:23:44.771110+0000 ctime 2024-04-01T15:23:44.777429+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f0354023040 con 0x564e0d879fc0 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) n = 1 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 1 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 flush_caps_sync 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 trim_cache size 0 max 16384 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) n = 11 2024-04-01T15:23:44.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 15 client.4698 remove_cap last one, closing snaprealm 0x7f033000a740 2024-04-01T15:23:44.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_snap_realm 0x1 0x7f033000a740 2 -> 1 2024-04-01T15:23:44.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- COMPLETE has_dir_layout 0x7f033000a830) 2024-04-01T15:23:44.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 _put_inode on 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) n = 15 2024-04-01T15:23:44.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 remove_cap mds.0 on 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) 2024-04-01T15:23:44.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 15 client.4698 remove_cap last one, closing snaprealm 0x7f033000a740 2024-04-01T15:23:44.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 20 client.4698 put_snap_realm 0x1 0x7f033000a740 1 -> 0 2024-04-01T15:23:44.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 10 client.4698 _put_inode deleting 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-01T15:23:44.771110+0000 mtime=2024-04-01T15:23:44.771110+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=1 caps=- objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f033000ae10) 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 2 client.4698 _close_mds_session mds.0 seq 2 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close seq 2) -- 0x564e0d712f80 con 0x564e0d879fc0 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f036683d480 2 client.4698 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 mds.0 seq now 3 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close seq 3) -- 0x7f033000a520 con 0x564e0d879fc0 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 5 client.4698 handle_caps don't have vino 0x10000000002.head op 0, immediately releasing 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_cap_release(3) -- 0x564e0d712dd0 con 0x564e0d879fc0 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 20 client.4698 trim_cache size 0 max 16384 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.789+0000 7f0360a00640 10 client.4698 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 <== mds.0 v2:172.21.15.179:6834/1191595510 10 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x7f033000a520 con 0x564e0d879fc0 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 10 client.4698 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 5 client.4698 _closed_mds_session mds.0 seq 3 2024-04-01T15:23:44.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 1 -- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 msgr2=0x564e0d751e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 10 client.4698 remove_session_caps mds.0 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 10 client.4698 kick_requests_closed for mds.0 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 10 client.4698 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 20 client.4698 trim_cache size 0 max 16384 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f0360a00640 10 client.4698 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f036683d480 2 client.4698 unmounted. 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f036683d480 1 client.4698 shutdown 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d879a90 msgr2=0x564e0d74b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.792+0000 7f036683d480 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d879a90 0x564e0d74b390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f035c044880 tx=0x7f035c078000 comp rx=0 tx=0).stop 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.793+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 shutdown_connections 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.793+0000 7f036683d480 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=CLOSED pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.793+0000 7f036683d480 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d879a90 0x564e0d74b390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.793+0000 7f036683d480 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d876090 0x564e0d86f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.793+0000 7f036683d480 1 --2- 172.21.15.142:0/2555715412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.793+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 >> 172.21.15.142:0/2555715412 conn(0x564e0d750560 msgr2=0x564e0d7515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.793+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 shutdown_connections 2024-04-01T15:23:44.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.793+0000 7f036683d480 1 -- 172.21.15.142:0/2555715412 wait complete. 2024-04-01T15:23:44.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.793+0000 7f036683d480 20 client.4698 trim_cache size 0 max 16384 2024-04-01T15:23:44.812 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestClient.LlreadvLlwritevOPathFileHandle (56 ms) 2024-04-01T15:23:44.812 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestClient.LlreadvLlwritevReadOnlyFile 2024-04-01T15:23:44.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.794+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.795+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0330006db0 con 0x564e0d71f2f0 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d875cd0 con 0x564e0d879a90 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d875e80 con 0x564e0d876090 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53042/0 (socket says 172.21.15.142:53042) 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f035a800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f0363c00640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.796+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 learned_addr learned my addr 172.21.15.142:0/3596921880 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.797+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 msgr2=0x564e0d74b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.797+0000 7f0363200640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.797+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 msgr2=0x564e0d7daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.797+0000 7f0363200640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.797+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d7098c0 con 0x564e0d71f2f0 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0363200640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x564e0d7d03d0 tx=0x7f0354019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3e884ddfd3ae25 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0361e00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035404e080 con 0x564e0d71f2f0 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0354046bf0 con 0x564e0d71f2f0 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f036683d480 10 client.4701 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d873b20 con 0x564e0d71f2f0 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 tick 2024-04-01T15:23:44.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 collect_and_send_metrics 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 collect_and_send_global_metrics 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0358a00640 5 client.4701 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.798+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564e0d712dd0 con 0x564e0d71f2f0 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f0354046df0 con 0x564e0d71f2f0 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f0361e00640 1 client.4701 handle_mds_map epoch 8 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f036683d480 20 client.4701 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f036683d480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f036683d480 20 client.4701 mds is 0 2024-04-01T15:23:44.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f036683d480 10 client.4701 _open_mds_session mds.0 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f036683d480 10 client.4701 waiting for session to mds.0 to open 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.799+0000 7f035a800640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.800+0000 7f0361e00640 10 client.4701 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.800+0000 7f035a800640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc1be271e514939 server_cookie=b3df367d376abe79 in_seq=0 out_seq=0 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f0361e00640 10 client.4701 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f0361e00640 10 client.4701 renew_caps mds.0 2024-04-01T15:23:44.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f033000a830 con 0x564e0d879fc0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f0361e00640 10 client.4701 connect_mds_targets for mds.0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f036683d480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 mds is 0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f036683d480 10 client.4701 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 encode_cap_releases enter (req: 0x564e0d7e0260, mds: 0) 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 send_request set sent_stamp to 2024-04-01T15:23:44.808710+0000 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f036683d480 10 client.4701 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.800193+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.800193+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d74e460 con 0x564e0d879fc0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 awaiting reply|forward|kick on 0x7ffc35e46ce0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f033000a830 con 0x564e0d879fc0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f034c005df0 con 0x564e0d879fc0 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 insert_trace from 2024-04-01T15:23:44.808710+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 features 0xffffffffffffffff 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 update_snap_trace len 70 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0x7f03300058a0, nref now is 1 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 15 client.4701 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 15 client.4701 snapc 1=[] 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_snap_realm 0x1 0x7f03300058a0 2 -> 1 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f033000aa50) - ctime 2024-04-01T15:23:44.777429+0000 mtime 2024-04-01T15:23:44.777429+0000 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 dir hash is 2 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 12 client.4701 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 12 client.4701 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- has_dir_layout 0x7f033000aa50) caps pAsLsXsFs 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0x7f03300058a0, nref was 1 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0x7f03300058a0, nref now is 2 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 15 client.4701 add_update_cap first one, opened snaprealm 0x7f03300058a0 2024-04-01T15:23:44.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_snap_realm 0x1 0x7f03300058a0 2 -> 1 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 handle_client_reply signalling caller 0x7ffc35e46ce0 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 handle_client_reply awaiting kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 sendrecv kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 lat 0.001148 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 _ll_get 0x7f033000aa50 0x1 -> 1 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 unmount 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size was 0+1 2024-04-01T15:23:44.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size still 0+1 2024-04-01T15:23:44.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 unmounting 2024-04-01T15:23:44.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _ll_drop_pins 2024-04-01T15:23:44.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 _ll_put 0x7f033000aa50 0x1 1 -> 0 2024-04-01T15:23:44.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 nothing to flush 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 flush_caps_sync 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 8 2024-04-01T15:23:44.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 15 client.4701 remove_cap last one, closing snaprealm 0x7f03300058a0 2024-04-01T15:23:44.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_snap_realm 0x1 0x7f03300058a0 1 -> 0 2024-04-01T15:23:44.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 _close_mds_session mds.0 seq 0 2024-04-01T15:23:44.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close) -- 0x564e0d880910 con 0x564e0d879fc0 2024-04-01T15:23:44.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x564e0d880910 con 0x564e0d879fc0 2024-04-01T15:23:44.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 5 client.4701 _closed_mds_session mds.0 seq 0 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 msgr2=0x564e0d751e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 remove_session_caps mds.0 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 kick_requests_closed for mds.0 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f036683d480 2 client.4701 unmounted. 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f036683d480 1 client.4701 shutdown 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 msgr2=0x564e0d7dcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.812+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x564e0d7d03d0 tx=0x7f0354019000 comp rx=0 tx=0).stop 2024-04-01T15:23:44.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 shutdown_connections 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=CLOSED pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 >> 172.21.15.142:0/3596921880 conn(0x564e0d750560 msgr2=0x564e0d7515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 shutdown_connections 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 wait complete. 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.813+0000 7f036683d480 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.814+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.815+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.815+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 0x564e0d74b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.815+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.815+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.815+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0330007bc0 con 0x564e0d876090 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.815+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d874e50 con 0x564e0d71f2f0 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.815+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d876470 con 0x564e0d879a90 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53044/0 (socket says 172.21.15.142:53044) 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 learned_addr learned my addr 172.21.15.142:0/3824558164 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f0363200640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 0x564e0d74b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f0363c00640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 msgr2=0x564e0d7daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 msgr2=0x564e0d74b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 0x564e0d74b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d71bbb0 con 0x564e0d876090 2024-04-01T15:23:44.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f036683d480 10 client.4704 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mdsmap=0+}) -- 0x564e0d86cb80 con 0x564e0d876090 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 tick 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 collect_and_send_metrics 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 collect_and_send_global_metrics 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f0359400640 5 client.4704 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 trim_cache size 0 max 16384 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f035a800640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f034c005870 tx=0x7f034c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792a801bc5d920a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f0360a00640 10 client.4704 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c007ca0 con 0x564e0d876090 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f034c046b30 con 0x564e0d876090 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f034c041030 con 0x564e0d876090 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f0360a00640 1 client.4704 handle_mds_map epoch 8 2024-04-01T15:23:44.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f036683d480 20 client.4704 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f036683d480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f036683d480 20 client.4704 mds is 0 2024-04-01T15:23:44.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f036683d480 10 client.4704 _open_mds_session mds.0 2024-04-01T15:23:44.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f036683d480 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d7515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d880b60 con 0x564e0d879fc0 2024-04-01T15:23:44.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.817+0000 7f036683d480 10 client.4704 waiting for session to mds.0 to open 2024-04-01T15:23:44.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.818+0000 7f0363200640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d7515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.819+0000 7f0363200640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d7515d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d049c6eff623b784 server_cookie=ff503aa4db373ab8 in_seq=0 out_seq=0 2024-04-01T15:23:44.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.819+0000 7f0360a00640 10 client.4704 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d880b60 con 0x564e0d879fc0 2024-04-01T15:23:44.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f0360a00640 10 client.4704 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f0360a00640 10 client.4704 renew_caps mds.0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f0328009520 con 0x564e0d879fc0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f0360a00640 10 client.4704 connect_mds_targets for mds.0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f036683d480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 mds is 0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f036683d480 10 client.4704 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 encode_cap_releases enter (req: 0x564e0d7d61a0, mds: 0) 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 send_request set sent_stamp to 2024-04-01T15:23:44.823936+0000 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f036683d480 10 client.4704 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.818750+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.818750+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d751d90 con 0x564e0d879fc0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 awaiting reply|forward|kick on 0x7ffc35e469f0 2024-04-01T15:23:44.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f0328009520 con 0x564e0d879fc0 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f035401e070 con 0x564e0d879fc0 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 insert_trace from 2024-04-01T15:23:44.823936+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 features 0xffffffffffffffff 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 update_snap_trace len 70 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 1 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 15 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 15 client.4704 snapc 1=[] 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 put_snap_realm 0x1 0x7f0328009740 2 -> 1 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f0328009830) - ctime 2024-04-01T15:23:44.777429+0000 mtime 2024-04-01T15:23:44.777429+0000 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 dir hash is 2 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 12 client.4704 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- has_dir_layout 0x7f0328009830) caps pAsLsXsFs 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref was 1 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 2 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f0328009740 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 put_snap_realm 0x1 0x7f0328009740 2 -> 1 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 handle_client_reply signalling caller 0x7ffc35e469f0 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 handle_client_reply awaiting kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f036683d480 20 client.4704 sendrecv kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f036683d480 20 client.4704 lat 0.001097 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f036683d480 20 client.4704 _ll_get 0x7f0328009830 0x1 -> 1 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f036683d480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevreadonlyfile45288 0666 576, uid 0, gid 0 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.823+0000 7f036683d480 10 client.4704 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) dn 'test_llreadvllwritevreadonlyfile45288' 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830); UserPerm(uid: 0, gid: 0) 2024-04-01T15:23:44.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 _getattr mask As issued=1 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 3 client.4704 may_create 0x7f0328009830 = 0 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 8 client.4704 _create(0x1 test_llreadvllwritevreadonlyfile45288, 0666) 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) name test_llreadvllwritevreadonlyfile45288 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 15 open_dir 0x564e0d751bf0 on 0x7f0328009830 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 15 client.4704 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) 'test_llreadvllwritevreadonlyfile45288' dn 0x1.head["test_llreadvllwritevreadonlyfile45288"] (new dn) 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 choose_target_mds inode dir hash is 2 on test_llreadvllwritevreadonlyfile45288 => 3886579998 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) is_hash=1 hash=3886579998 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 mds is 0 2024-04-01T15:23:44.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 send_request rebuilding request 2 for mds.0 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 encode_cap_releases enter (req: 0x564e0d751d90, mds: 0) 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 encode_dentry_release enter(dn:0x7f033000a740) 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830), req:0x564e0d751d90 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 send_request set sent_stamp to 2024-04-01T15:23:44.825151+0000 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile45288 2024-04-01T15:23:44.825116+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile45288 2024-04-01T15:23:44.825116+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d889660 con 0x564e0d879fc0 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 awaiting reply|forward|kick on 0x7ffc35e46830 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f0360a00640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) n = 1 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.824+0000 7f0360a00640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) n = 1 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 858+0+0 (crc 0 0 0) 0x7f0354017250 con 0x564e0d879fc0 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 2 2024-04-01T15:23:44.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 insert_trace from 2024-04-01T15:23:44.825151+0000 mds.0 is_target=1 is_dentry=1 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 features 0xffffffffffffffff 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_snap_trace len 70 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref was 1 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 2 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 hrm is_target=1 is_dentry=1 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_inode_file_time 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f0328009e10) - ctime 2024-04-01T15:23:44.825116+0000 mtime 2024-04-01T15:23:44.825116+0000 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode adding 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f0328009e10) caps pAsxLsXsxFscr 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref was 2 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 3 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f0328009740 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 add_update_cap issued - -> pAsxLsXsxFscr from mds.0 on 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f0328009e10) 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) caps pAsLsXs 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) pAsLsXs ctime 2024-04-01T15:23:44.825116+0000 mtime 2024-04-01T15:23:44.825116+0000 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 dir hash is 2 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode client inode change_attr: 6 , mds inodestat change_attr: 7 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 got dirfrag map for 0x1 frag * to mds 0 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 insert_dentry_inode 'test_llreadvllwritevreadonlyfile45288' vino 0x10000000003.head in dir 0x1.head dn 0x7f033000a740 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 15 client.4704 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) 'test_llreadvllwritevreadonlyfile45288' to inode 0x7f0328009e10 dn 0x1.head["test_llreadvllwritevreadonlyfile45288"] (old dn) 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 link inode 0x7f0328009e10 parents now 0x1.head["test_llreadvllwritevreadonlyfile45288"] 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 15 client.4704 update_dentry_lease 0x1.head["test_llreadvllwritevreadonlyfile45288"] lease(mask 7 dur 30000) from 2024-04-01T15:23:44.825151+0000 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 got dentry lease on test_llreadvllwritevreadonlyfile45288 dur 30000ms ttl 2024-04-01T15:24:14.825151+0000 2024-04-01T15:23:44.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 put_snap_realm 0x1 0x7f0328009740 3 -> 2 2024-04-01T15:23:44.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 handle_client_reply signalling caller 0x7ffc35e46830 2024-04-01T15:23:44.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 handle_client_reply awaiting kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 sendrecv kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 delegated_inos: [] 2024-04-01T15:23:44.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 make_request created ino 0x10000000003 2024-04-01T15:23:44.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 make_request target is 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 lat 0.005781 2024-04-01T15:23:44.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 10 break_deleg: breaking delegs on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 10 delegations_broken: delegations empty on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 _create_fh 0x10000000003 mode 1 2024-04-01T15:23:44.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 trim_cache size 1 max 16384 2024-04-01T15:23:44.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 8 client.4704 create(#0x1/test_llreadvllwritevreadonlyfile45288, 0100666 layout 0 0 0) = 0 2024-04-01T15:23:44.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 _ll_create created = 1 2024-04-01T15:23:44.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevreadonlyfile45288 0666 576 = 0 (0x564e0d752240 10000000003) 2024-04-01T15:23:44.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 _ll_get 0x7f0328009e10 0x10000000003 -> 1 2024-04-01T15:23:44.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 fill_statx on 0x10000000003 snap/devhead mode 0100666 mtime 2024-04-01T15:23:44.825116+0000 ctime 2024-04-01T15:23:44.825116+0000 change_attr 0 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 3 client.4704 pwritev(0x564e0d752240, "...", 14, 0) = -9 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.829+0000 7f036683d480 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x564e0d7c15a0 0x564e0d7c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.830+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- osd_op(unknown.0.0:1 3.32 3:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x564e0d7c1f60 con 0x564e0d7c15a0 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.830+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- osd_op(unknown.0.0:2 3.32 3:4def72d4:::10000000003.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x564e0d742da0 con 0x564e0d7c15a0 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.830+0000 7f0360a00640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.830+0000 7f0360a00640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) n = 1 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.830+0000 7f0363c00640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x564e0d7c15a0 0x564e0d7c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.830+0000 7f0363c00640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x564e0d7c15a0 0x564e0d7c1a20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=a57a7a9d822c167 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.830+0000 7f0360a00640 10 client.4704 ms_handle_connect on v2:172.21.15.142:6808/3934118532 2024-04-01T15:23:44.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.831+0000 7f0363c00640 1 -- 172.21.15.142:0/3824558164 <== osd.0 v2:172.21.15.142:6808/3934118532 1 ==== osd_op_reply(1 10000000003.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f035c05a040 con 0x564e0d7c15a0 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.833+0000 7f0363c00640 1 -- 172.21.15.142:0/3824558164 <== osd.0 v2:172.21.15.142:6808/3934118532 2 ==== osd_op_reply(2 10000000003.00000000 [create] v22'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f035c05a040 con 0x564e0d7c15a0 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.833+0000 7f036683d480 10 client.4704 get_caps 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) have pAsxLsXsxFscr need Fr want Fc revoking - 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.833+0000 7f036683d480 10 client.4704 _read_async 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=1} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 0~14 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.833+0000 7f036683d480 -1 put_cap_ref Fc went negative on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={1024=0,2048=1} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2574-gd2271579/rpm/el9/BUILD/ceph-19.0.0-2574-gd2271579/src/client/Inode.cc: In function 'int Inode::put_cap_ref(int)' thread 7f036683d480 time 2024-04-01T15:23:44.834544+0000 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2574-gd2271579/rpm/el9/BUILD/ceph-19.0.0-2574-gd2271579/src/client/Inode.cc: 207: FAILED ceph_assert(cap_refs[c] > 0) 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-2574-gd2271579 (d2271579d5e735cfd6d436b8349c004f06527cb0) squid (dev) 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0367380f3a] 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x1810f8) [0x7f03673810f8] 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (Inode::put_cap_ref(int)+0x313) [0x564e0cb5c643] 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (Client::put_cap_ref(Inode*, int)+0x32) [0x564e0cad74e2] 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (Client::C_Read_Async_Finisher::finish(int)+0x21) [0x564e0cb139a1] 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr: 6: ceph_test_client(+0xb7fad) [0x564e0ca8bfad] 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (Client::_read_async(Fh*, unsigned long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0xdc) [0x564e0cb13abc] 2024-04-01T15:23:44.868 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (Client::_read(Fh*, long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0x25c) [0x564e0cb14a7c] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (Client::_preadv_pwritev_locked(Fh*, iovec const*, int, long, bool, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x10d) [0x564e0cb1acdd] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 10: (Client::ll_preadv_pwritev(Fh*, iovec const*, int, long, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x2d2) [0x564e0cb3d822] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 11: (TestClient_LlreadvLlwritevReadOnlyFile_Test::TestBody()+0x431) [0x564e0caa5091] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 12: ceph_test_client(+0x2461ec) [0x564e0cc1a1ec] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 13: (testing::Test::Run()+0xe3) [0x564e0cb85d43] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 14: ceph_test_client(+0x1d1165) [0x564e0cba5165] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 15: ceph_test_client(+0x1d12f9) [0x564e0cba52f9] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 16: (testing::internal::UnitTestImpl::RunAllTests()+0x804) [0x564e0cb97604] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 17: (testing::UnitTest::Run()+0x1a8) [0x564e0cb939a8] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 18: main() 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 19: /lib64/libc.so.6(+0x3feb0) [0x7f0366a3feb0] 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 20: __libc_start_main() 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr: 21: _start() 2024-04-01T15:23:44.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.834+0000 7f036683d480 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2574-gd2271579/rpm/el9/BUILD/ceph-19.0.0-2574-gd2271579/src/client/Inode.cc: In function 'int Inode::put_cap_ref(int)' thread 7f036683d480 time 2024-04-01T15:23:44.834544+0000 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2574-gd2271579/rpm/el9/BUILD/ceph-19.0.0-2574-gd2271579/src/client/Inode.cc: 207: FAILED ceph_assert(cap_refs[c] > 0) 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-2574-gd2271579 (d2271579d5e735cfd6d436b8349c004f06527cb0) squid (dev) 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0367380f3a] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x1810f8) [0x7f03673810f8] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (Inode::put_cap_ref(int)+0x313) [0x564e0cb5c643] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (Client::put_cap_ref(Inode*, int)+0x32) [0x564e0cad74e2] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (Client::C_Read_Async_Finisher::finish(int)+0x21) [0x564e0cb139a1] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 6: ceph_test_client(+0xb7fad) [0x564e0ca8bfad] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (Client::_read_async(Fh*, unsigned long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0xdc) [0x564e0cb13abc] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (Client::_read(Fh*, long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0x25c) [0x564e0cb14a7c] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (Client::_preadv_pwritev_locked(Fh*, iovec const*, int, long, bool, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x10d) [0x564e0cb1acdd] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 10: (Client::ll_preadv_pwritev(Fh*, iovec const*, int, long, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x2d2) [0x564e0cb3d822] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 11: (TestClient_LlreadvLlwritevReadOnlyFile_Test::TestBody()+0x431) [0x564e0caa5091] 2024-04-01T15:23:44.870 INFO:tasks.workunit.client.0.smithi142.stderr: 12: ceph_test_client(+0x2461ec) [0x564e0cc1a1ec] 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 13: (testing::Test::Run()+0xe3) [0x564e0cb85d43] 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 14: ceph_test_client(+0x1d1165) [0x564e0cba5165] 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 15: ceph_test_client(+0x1d12f9) [0x564e0cba52f9] 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 16: (testing::internal::UnitTestImpl::RunAllTests()+0x804) [0x564e0cb97604] 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 17: (testing::UnitTest::Run()+0x1a8) [0x564e0cb939a8] 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 18: main() 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 19: /lib64/libc.so.6(+0x3feb0) [0x7f0366a3feb0] 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 20: __libc_start_main() 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 21: _start() 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr:*** Caught signal (Aborted) ** 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f036683d480 thread_name:ceph_test_clien 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-2574-gd2271579 (d2271579d5e735cfd6d436b8349c004f06527cb0) squid (dev) 2024-04-01T15:23:44.871 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0366a54db0] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0366aa154c] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0367380f94] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x1810f8) [0x7f03673810f8] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (Inode::put_cap_ref(int)+0x313) [0x564e0cb5c643] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (Client::put_cap_ref(Inode*, int)+0x32) [0x564e0cad74e2] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (Client::C_Read_Async_Finisher::finish(int)+0x21) [0x564e0cb139a1] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 10: ceph_test_client(+0xb7fad) [0x564e0ca8bfad] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 11: (Client::_read_async(Fh*, unsigned long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0xdc) [0x564e0cb13abc] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 12: (Client::_read(Fh*, long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0x25c) [0x564e0cb14a7c] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 13: (Client::_preadv_pwritev_locked(Fh*, iovec const*, int, long, bool, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x10d) [0x564e0cb1acdd] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 14: (Client::ll_preadv_pwritev(Fh*, iovec const*, int, long, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x2d2) [0x564e0cb3d822] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 15: (TestClient_LlreadvLlwritevReadOnlyFile_Test::TestBody()+0x431) [0x564e0caa5091] 2024-04-01T15:23:44.872 INFO:tasks.workunit.client.0.smithi142.stderr: 16: ceph_test_client(+0x2461ec) [0x564e0cc1a1ec] 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 17: (testing::Test::Run()+0xe3) [0x564e0cb85d43] 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 18: ceph_test_client(+0x1d1165) [0x564e0cba5165] 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 19: ceph_test_client(+0x1d12f9) [0x564e0cba52f9] 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 20: (testing::internal::UnitTestImpl::RunAllTests()+0x804) [0x564e0cb97604] 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 21: (testing::UnitTest::Run()+0x1a8) [0x564e0cb939a8] 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 22: main() 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 23: /lib64/libc.so.6(+0x3feb0) [0x7f0366a3feb0] 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 24: __libc_start_main() 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 25: _start() 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-04-01T15:23:44.834+0000 7f036683d480 -1 *** Caught signal (Aborted) ** 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f036683d480 thread_name:ceph_test_clien 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-2574-gd2271579 (d2271579d5e735cfd6d436b8349c004f06527cb0) squid (dev) 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0366a54db0] 2024-04-01T15:23:44.873 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0366aa154c] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0367380f94] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x1810f8) [0x7f03673810f8] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (Inode::put_cap_ref(int)+0x313) [0x564e0cb5c643] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (Client::put_cap_ref(Inode*, int)+0x32) [0x564e0cad74e2] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (Client::C_Read_Async_Finisher::finish(int)+0x21) [0x564e0cb139a1] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 10: ceph_test_client(+0xb7fad) [0x564e0ca8bfad] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 11: (Client::_read_async(Fh*, unsigned long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0xdc) [0x564e0cb13abc] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 12: (Client::_read(Fh*, long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0x25c) [0x564e0cb14a7c] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 13: (Client::_preadv_pwritev_locked(Fh*, iovec const*, int, long, bool, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x10d) [0x564e0cb1acdd] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 14: (Client::ll_preadv_pwritev(Fh*, iovec const*, int, long, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x2d2) [0x564e0cb3d822] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 15: (TestClient_LlreadvLlwritevReadOnlyFile_Test::TestBody()+0x431) [0x564e0caa5091] 2024-04-01T15:23:44.874 INFO:tasks.workunit.client.0.smithi142.stderr: 16: ceph_test_client(+0x2461ec) [0x564e0cc1a1ec] 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 17: (testing::Test::Run()+0xe3) [0x564e0cb85d43] 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 18: ceph_test_client(+0x1d1165) [0x564e0cba5165] 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 19: ceph_test_client(+0x1d12f9) [0x564e0cba52f9] 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 20: (testing::internal::UnitTestImpl::RunAllTests()+0x804) [0x564e0cb97604] 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 21: (testing::UnitTest::Run()+0x1a8) [0x564e0cb939a8] 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 22: main() 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 23: /lib64/libc.so.6(+0x3feb0) [0x7f0366a3feb0] 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 24: __libc_start_main() 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 25: _start() 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.875 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-04-01T15:23:44.794+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-04-01T15:23:44.794+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.876 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-04-01T15:23:44.794+0000 7f036683d480 10 monclient: build_initial_monmap 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-04-01T15:23:44.794+0000 7f036683d480 1 build_initial for_mkfs: 0 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-04-01T15:23:44.794+0000 7f036683d480 10 monclient: monmap: 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.noname-c 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-04-01T15:23:44.794+0000 7f036683d480 10 monclient: init 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding auth protocol: cephx 2024-04-01T15:23:44.877 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding auth protocol: cephx 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding auth protocol: cephx 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.878 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-04-01T15:23:44.795+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-04-01T15:23:44.795+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-04-01T15:23:44.795+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-04-01T15:23:44.795+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command rotate-key hook 0x564e0d87dda8 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-04-01T15:23:44.796+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command objecter_requests hook 0x564e0d873ef0 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient: _renew_subs 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient: _reopen_session rank -1 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient: _add_conns ranks=[0,2,1] 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-04-01T15:23:44.796+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): picked mon.noname-a con 0x564e0d71f2f0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-04-01T15:23:44.796+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): picked mon.noname-c con 0x564e0d876090 addr [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-04-01T15:23:44.796+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.879 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): picked mon.noname-b con 0x564e0d879a90 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-04-01T15:23:44.796+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0330006db0 con 0x564e0d71f2f0 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-04-01T15:23:44.796+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d875cd0 con 0x564e0d879a90 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-04-01T15:23:44.796+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d875e80 con 0x564e0d876090 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): _renew_subs 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-04-01T15:23:44.796+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-04-01T15:23:44.796+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53042/0 (socket says 172.21.15.142:53042) 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-04-01T15:23:44.796+0000 7f035a800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-04-01T15:23:44.796+0000 7f0363c00640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): get_auth_request con 0x564e0d876090 auth_method 0 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.880 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-04-01T15:23:44.796+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 learned_addr learned my addr 172.21.15.142:0/3596921880 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): get_auth_request con 0x564e0d71f2f0 auth_method 0 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): get_auth_request con 0x564e0d879a90 auth_method 0 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command mds_requests hook 0x564e0d7c0df8 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command mds_sessions hook 0x564e0d7c0df8 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command dump_cache hook 0x564e0d7c0df8 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command kick_stale_sessions hook 0x564e0d7c0df8 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command status hook 0x564e0d7c0df8 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-04-01T15:23:44.797+0000 7f036683d480 10 monclient(hunting): authenticate will time out at 1352.886274s 2024-04-01T15:23:44.881 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): handle_auth_done global_id 4701 payload 653 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-04-01T15:23:44.797+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 msgr2=0x564e0d74b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-04-01T15:23:44.797+0000 7f0363200640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-04-01T15:23:44.797+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 msgr2=0x564e0d7daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-04-01T15:23:44.797+0000 7f0363200640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.882 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient: _finish_hunting 0 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-04-01T15:23:44.797+0000 7f0363200640 1 monclient: found mon.noname-a 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-04-01T15:23:44.797+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d7098c0 con 0x564e0d71f2f0 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-04-01T15:23:44.798+0000 7f0363200640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x564e0d7d03d0 tx=0x7f0354019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3e884ddfd3ae25 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-04-01T15:23:44.798+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035404e080 con 0x564e0d71f2f0 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: handle_monmap mon_map magic: 0 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: dump: 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-04-01T15:20:53.018049+0000 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-04-01T15:20:53.018049+0000 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-04-01T15:23:44.883 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: _finish_auth 0 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: _check_auth_tickets 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-04-01T15:23:44.798+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0354046bf0 con 0x564e0d71f2f0 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-04-01T15:23:44.798+0000 7f036683d480 5 monclient: authenticate success, global_id 4701 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-04-01T15:23:44.798+0000 7f036683d480 10 client.4701 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-04-01T15:23:44.798+0000 7f036683d480 10 monclient: _renew_subs 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-04-01T15:23:44.798+0000 7f036683d480 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-04-01T15:23:44.798+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d873b20 con 0x564e0d71f2f0 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 tick 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 collect_and_send_metrics 2024-04-01T15:23:44.884 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 collect_and_send_global_metrics 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-04-01T15:23:44.798+0000 7f0358a00640 5 client.4701 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-04-01T15:23:44.798+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564e0d712dd0 con 0x564e0d71f2f0 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: handle_config config(0 keys) 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-04-01T15:23:44.799+0000 7f0362800640 4 set_mon_vals no callback set 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-04-01T15:23:44.799+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f0354046df0 con 0x564e0d71f2f0 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-04-01T15:23:44.799+0000 7f0361e00640 1 client.4701 handle_mds_map epoch 8 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-04-01T15:23:44.799+0000 7f036683d480 20 client.4701 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-04-01T15:23:44.799+0000 7f036683d480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-04-01T15:23:44.799+0000 7f036683d480 20 client.4701 mds is 0 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-04-01T15:23:44.799+0000 7f036683d480 10 client.4701 _open_mds_session mds.0 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-04-01T15:23:44.799+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-04-01T15:23:44.799+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.885 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-04-01T15:23:44.799+0000 7f036683d480 10 client.4701 waiting for session to mds.0 to open 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-04-01T15:23:44.799+0000 7f035a800640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-04-01T15:23:44.799+0000 7f035a800640 10 monclient: get_auth_request con 0x564e0d879fc0 auth_method 0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-04-01T15:23:44.800+0000 7f0361e00640 10 client.4701 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-04-01T15:23:44.800+0000 7f035a800640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc1be271e514939 server_cookie=b3df367d376abe79 in_seq=0 out_seq=0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-04-01T15:23:44.807+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-04-01T15:23:44.807+0000 7f0361e00640 10 client.4701 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-04-01T15:23:44.807+0000 7f0361e00640 10 client.4701 renew_caps mds.0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-04-01T15:23:44.807+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f033000a830 con 0x564e0d879fc0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-04-01T15:23:44.807+0000 7f0361e00640 10 client.4701 connect_mds_targets for mds.0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-04-01T15:23:44.807+0000 7f036683d480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 mds is 0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-04-01T15:23:44.807+0000 7f036683d480 10 client.4701 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 encode_cap_releases enter (req: 0x564e0d7e0260, mds: 0) 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 send_request set sent_stamp to 2024-04-01T15:23:44.808710+0000 2024-04-01T15:23:44.886 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-04-01T15:23:44.807+0000 7f036683d480 10 client.4701 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.800193+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-04-01T15:23:44.807+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.800193+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d74e460 con 0x564e0d879fc0 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 awaiting reply|forward|kick on 0x7ffc35e46ce0 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-04-01T15:23:44.808+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f033000a830 con 0x564e0d879fc0 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-04-01T15:23:44.808+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f034c005df0 con 0x564e0d879fc0 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 insert_trace from 2024-04-01T15:23:44.808710+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 features 0xffffffffffffffff 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 update_snap_trace len 70 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0x7f03300058a0, nref now is 1 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.887 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-04-01T15:23:44.808+0000 7f0361e00640 15 client.4701 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-04-01T15:23:44.808+0000 7f0361e00640 15 client.4701 snapc 1=[] 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_snap_realm 0x1 0x7f03300058a0 2 -> 1 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f033000aa50) - ctime 2024-04-01T15:23:44.777429+0000 mtime 2024-04-01T15:23:44.777429+0000 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 dir hash is 2 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-04-01T15:23:44.808+0000 7f0361e00640 12 client.4701 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-04-01T15:23:44.808+0000 7f0361e00640 12 client.4701 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- has_dir_layout 0x7f033000aa50) caps pAsLsXsFs 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0x7f03300058a0, nref was 1 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0x7f03300058a0, nref now is 2 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-04-01T15:23:44.808+0000 7f0361e00640 15 client.4701 add_update_cap first one, opened snaprealm 0x7f03300058a0 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.888 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_snap_realm 0x1 0x7f03300058a0 2 -> 1 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 handle_client_reply signalling caller 0x7ffc35e46ce0 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 handle_client_reply awaiting kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 sendrecv kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 lat 0.001148 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 _ll_get 0x7f033000aa50 0x1 -> 1 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 unmount 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.889 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size was 0+1 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size still 0+1 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 unmounting 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _ll_drop_pins 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 _ll_put 0x7f033000aa50 0x1 1 -> 0 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.890 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 nothing to flush 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 flush_caps_sync 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 8 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-04-01T15:23:44.808+0000 7f036683d480 15 client.4701 remove_cap last one, closing snaprealm 0x7f03300058a0 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_snap_realm 0x1 0x7f03300058a0 1 -> 0 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 _close_mds_session mds.0 seq 0 2024-04-01T15:23:44.891 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-04-01T15:23:44.808+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close) -- 0x564e0d880910 con 0x564e0d879fc0 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-04-01T15:23:44.812+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x564e0d880910 con 0x564e0d879fc0 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-04-01T15:23:44.812+0000 7f0361e00640 5 client.4701 _closed_mds_session mds.0 seq 0 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-04-01T15:23:44.812+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 msgr2=0x564e0d751e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-04-01T15:23:44.812+0000 7f0361e00640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 remove_session_caps mds.0 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 kick_requests_closed for mds.0 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-04-01T15:23:44.812+0000 7f0361e00640 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-04-01T15:23:44.812+0000 7f036683d480 2 client.4701 unmounted. 2024-04-01T15:23:44.892 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-04-01T15:23:44.812+0000 7f036683d480 1 client.4701 shutdown 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands dump_cache 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands kick_stale_sessions 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands mds_requests 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands mds_sessions 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands status 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands objecter_requests 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-04-01T15:23:44.812+0000 7f036683d480 10 monclient: shutdown 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands rotate-key 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-04-01T15:23:44.812+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 msgr2=0x564e0d7dcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-04-01T15:23:44.812+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x564e0d7d03d0 tx=0x7f0354019000 comp rx=0 tx=0).stop 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 shutdown_connections 2024-04-01T15:23:44.893 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=CLOSED pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 >> 172.21.15.142:0/3596921880 conn(0x564e0d750560 msgr2=0x564e0d7515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 shutdown_connections 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 wait complete. 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-04-01T15:23:44.813+0000 7f036683d480 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.894 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-04-01T15:23:44.814+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.895 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-04-01T15:23:44.814+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-04-01T15:23:44.814+0000 7f036683d480 10 monclient: build_initial_monmap 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-04-01T15:23:44.814+0000 7f036683d480 1 build_initial for_mkfs: 0 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-04-01T15:23:44.814+0000 7f036683d480 10 monclient: monmap: 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-04-01T15:23:44.896 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.noname-c 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-04-01T15:23:44.814+0000 7f036683d480 10 monclient: init 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding auth protocol: cephx 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding auth protocol: cephx 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding auth protocol: cephx 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.897 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-04-01T15:23:44.814+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-04-01T15:23:44.815+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.898 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-04-01T15:23:44.815+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-04-01T15:23:44.815+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command rotate-key hook 0x564e0d713308 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-04-01T15:23:44.815+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command objecter_requests hook 0x564e0d7e0ca0 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient: _renew_subs 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient: _reopen_session rank -1 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient: _add_conns ranks=[1,0,2] 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-04-01T15:23:44.815+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 0x564e0d74b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): picked mon.noname-b con 0x564e0d71f2f0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-04-01T15:23:44.815+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): picked mon.noname-a con 0x564e0d876090 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-04-01T15:23:44.815+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.899 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): picked mon.noname-c con 0x564e0d879a90 addr [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-04-01T15:23:44.815+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0330007bc0 con 0x564e0d876090 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-04-01T15:23:44.815+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d874e50 con 0x564e0d71f2f0 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-04-01T15:23:44.815+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d876470 con 0x564e0d879a90 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): _renew_subs 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53044/0 (socket says 172.21.15.142:53044) 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 learned_addr learned my addr 172.21.15.142:0/3824558164 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.900 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): get_auth_request con 0x564e0d876090 auth_method 0 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-04-01T15:23:44.816+0000 7f0363200640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 0x564e0d74b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-04-01T15:23:44.816+0000 7f0363c00640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-04-01T15:23:44.816+0000 7f0363200640 10 monclient(hunting): get_auth_request con 0x564e0d71f2f0 auth_method 0 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-04-01T15:23:44.816+0000 7f0363200640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-04-01T15:23:44.816+0000 7f0363200640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-04-01T15:23:44.816+0000 7f0363200640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.901 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-04-01T15:23:44.816+0000 7f0363c00640 10 monclient(hunting): get_auth_request con 0x564e0d879a90 auth_method 0 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-04-01T15:23:44.816+0000 7f0363c00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-04-01T15:23:44.816+0000 7f0363c00640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command mds_requests hook 0x564e0d7c0df8 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-04-01T15:23:44.816+0000 7f0363c00640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command mds_sessions hook 0x564e0d7c0df8 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command dump_cache hook 0x564e0d7c0df8 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): handle_auth_done global_id 4704 payload 653 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command kick_stale_sessions hook 0x564e0d7c0df8 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command status hook 0x564e0d7c0df8 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 msgr2=0x564e0d7daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 msgr2=0x564e0d74b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 0x564e0d74b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.902 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient: _finish_hunting 0 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-04-01T15:23:44.816+0000 7f035a800640 1 monclient: found mon.noname-a 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d71bbb0 con 0x564e0d876090 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-04-01T15:23:44.816+0000 7f036683d480 5 monclient: already authenticated 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-04-01T15:23:44.816+0000 7f036683d480 10 client.4704 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-04-01T15:23:44.816+0000 7f036683d480 10 monclient: _renew_subs 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-04-01T15:23:44.816+0000 7f036683d480 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-04-01T15:23:44.816+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mdsmap=0+}) -- 0x564e0d86cb80 con 0x564e0d876090 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 tick 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 collect_and_send_metrics 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 collect_and_send_global_metrics 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-04-01T15:23:44.816+0000 7f0359400640 5 client.4704 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 trim_cache size 0 max 16384 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.903 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-04-01T15:23:44.817+0000 7f035a800640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f034c005870 tx=0x7f034c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792a801bc5d920a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 client.4704 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-04-01T15:23:44.817+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c007ca0 con 0x564e0d876090 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: handle_monmap mon_map magic: 0 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: dump: 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-04-01T15:20:53.018049+0000 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-04-01T15:20:53.018049+0000 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.904 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: _finish_auth 0 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: _check_auth_tickets 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-04-01T15:23:44.817+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f034c046b30 con 0x564e0d876090 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-04-01T15:23:44.817+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f034c041030 con 0x564e0d876090 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-04-01T15:23:44.817+0000 7f0360a00640 1 client.4704 handle_mds_map epoch 8 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-04-01T15:23:44.817+0000 7f036683d480 20 client.4704 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-04-01T15:23:44.817+0000 7f036683d480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-04-01T15:23:44.817+0000 7f036683d480 20 client.4704 mds is 0 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-04-01T15:23:44.817+0000 7f036683d480 10 client.4704 _open_mds_session mds.0 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-04-01T15:23:44.817+0000 7f036683d480 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d7515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-04-01T15:23:44.817+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d880b60 con 0x564e0d879fc0 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-04-01T15:23:44.817+0000 7f036683d480 10 client.4704 waiting for session to mds.0 to open 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-04-01T15:23:44.818+0000 7f0363200640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d7515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-04-01T15:23:44.818+0000 7f0363200640 10 monclient: get_auth_request con 0x564e0d879fc0 auth_method 0 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-04-01T15:23:44.819+0000 7f0363200640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d7515d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d049c6eff623b784 server_cookie=ff503aa4db373ab8 in_seq=0 out_seq=0 2024-04-01T15:23:44.905 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-04-01T15:23:44.819+0000 7f0360a00640 10 client.4704 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-04-01T15:23:44.822+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d880b60 con 0x564e0d879fc0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-04-01T15:23:44.822+0000 7f0360a00640 10 client.4704 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-04-01T15:23:44.822+0000 7f0360a00640 10 client.4704 renew_caps mds.0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-04-01T15:23:44.822+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f0328009520 con 0x564e0d879fc0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-04-01T15:23:44.822+0000 7f0360a00640 10 client.4704 connect_mds_targets for mds.0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-04-01T15:23:44.822+0000 7f036683d480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 mds is 0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-04-01T15:23:44.822+0000 7f036683d480 10 client.4704 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 encode_cap_releases enter (req: 0x564e0d7d61a0, mds: 0) 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 send_request set sent_stamp to 2024-04-01T15:23:44.823936+0000 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-04-01T15:23:44.822+0000 7f036683d480 10 client.4704 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.818750+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-04-01T15:23:44.822+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.818750+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d751d90 con 0x564e0d879fc0 2024-04-01T15:23:44.906 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 awaiting reply|forward|kick on 0x7ffc35e469f0 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-04-01T15:23:44.823+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f0328009520 con 0x564e0d879fc0 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-04-01T15:23:44.823+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f035401e070 con 0x564e0d879fc0 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 insert_trace from 2024-04-01T15:23:44.823936+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 features 0xffffffffffffffff 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 update_snap_trace len 70 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 1 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-04-01T15:23:44.823+0000 7f0360a00640 15 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-04-01T15:23:44.823+0000 7f0360a00640 15 client.4704 snapc 1=[] 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.907 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 put_snap_realm 0x1 0x7f0328009740 2 -> 1 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f0328009830) - ctime 2024-04-01T15:23:44.777429+0000 mtime 2024-04-01T15:23:44.777429+0000 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 dir hash is 2 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-04-01T15:23:44.823+0000 7f0360a00640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-04-01T15:23:44.823+0000 7f0360a00640 12 client.4704 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- has_dir_layout 0x7f0328009830) caps pAsLsXsFs 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref was 1 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 2 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-04-01T15:23:44.823+0000 7f0360a00640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f0328009740 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 put_snap_realm 0x1 0x7f0328009740 2 -> 1 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 handle_client_reply signalling caller 0x7ffc35e469f0 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 handle_client_reply awaiting kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.908 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-04-01T15:23:44.823+0000 7f036683d480 20 client.4704 sendrecv kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-04-01T15:23:44.823+0000 7f036683d480 20 client.4704 lat 0.001097 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-04-01T15:23:44.823+0000 7f036683d480 20 client.4704 _ll_get 0x7f0328009830 0x1 -> 1 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-04-01T15:23:44.823+0000 7f036683d480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevreadonlyfile45288 0666 576, uid 0, gid 0 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-04-01T15:23:44.823+0000 7f036683d480 10 client.4704 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) dn 'test_llreadvllwritevreadonlyfile45288' 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830); UserPerm(uid: 0, gid: 0) 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 _getattr mask As issued=1 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-04-01T15:23:44.824+0000 7f036683d480 3 client.4704 may_create 0x7f0328009830 = 0 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-04-01T15:23:44.824+0000 7f036683d480 8 client.4704 _create(0x1 test_llreadvllwritevreadonlyfile45288, 0666) 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) name test_llreadvllwritevreadonlyfile45288 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-04-01T15:23:44.824+0000 7f036683d480 15 open_dir 0x564e0d751bf0 on 0x7f0328009830 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-04-01T15:23:44.824+0000 7f036683d480 15 client.4704 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) 'test_llreadvllwritevreadonlyfile45288' dn 0x1.head["test_llreadvllwritevreadonlyfile45288"] (new dn) 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 choose_target_mds inode dir hash is 2 on test_llreadvllwritevreadonlyfile45288 => 3886579998 2024-04-01T15:23:44.909 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) is_hash=1 hash=3886579998 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 mds is 0 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 send_request rebuilding request 2 for mds.0 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 encode_cap_releases enter (req: 0x564e0d751d90, mds: 0) 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 encode_dentry_release enter(dn:0x7f033000a740) 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830), req:0x564e0d751d90 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 send_request set sent_stamp to 2024-04-01T15:23:44.825151+0000 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile45288 2024-04-01T15:23:44.825116+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-04-01T15:23:44.824+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile45288 2024-04-01T15:23:44.825116+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d889660 con 0x564e0d879fc0 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 awaiting reply|forward|kick on 0x7ffc35e46830 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-04-01T15:23:44.824+0000 7f0360a00640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) n = 1 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-04-01T15:23:44.824+0000 7f0360a00640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) n = 1 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-04-01T15:23:44.829+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 858+0+0 (crc 0 0 0) 0x7f0354017250 con 0x564e0d879fc0 2024-04-01T15:23:44.910 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 2 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 insert_trace from 2024-04-01T15:23:44.825151+0000 mds.0 is_target=1 is_dentry=1 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 features 0xffffffffffffffff 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_snap_trace len 70 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref was 1 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 2 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 hrm is_target=1 is_dentry=1 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_inode_file_time 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f0328009e10) - ctime 2024-04-01T15:23:44.825116+0000 mtime 2024-04-01T15:23:44.825116+0000 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode adding 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f0328009e10) caps pAsxLsXsxFscr 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref was 2 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 3 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-04-01T15:23:44.829+0000 7f0360a00640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f0328009740 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 add_update_cap issued - -> pAsxLsXsxFscr from mds.0 on 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f0328009e10) 2024-04-01T15:23:44.911 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) caps pAsLsXs 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) pAsLsXs ctime 2024-04-01T15:23:44.825116+0000 mtime 2024-04-01T15:23:44.825116+0000 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 dir hash is 2 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode client inode change_attr: 6 , mds inodestat change_attr: 7 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 got dirfrag map for 0x1 frag * to mds 0 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 insert_dentry_inode 'test_llreadvllwritevreadonlyfile45288' vino 0x10000000003.head in dir 0x1.head dn 0x7f033000a740 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-04-01T15:23:44.829+0000 7f0360a00640 15 client.4704 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) 'test_llreadvllwritevreadonlyfile45288' to inode 0x7f0328009e10 dn 0x1.head["test_llreadvllwritevreadonlyfile45288"] (old dn) 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 link inode 0x7f0328009e10 parents now 0x1.head["test_llreadvllwritevreadonlyfile45288"] 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-04-01T15:23:44.829+0000 7f0360a00640 15 client.4704 update_dentry_lease 0x1.head["test_llreadvllwritevreadonlyfile45288"] lease(mask 7 dur 30000) from 2024-04-01T15:23:44.825151+0000 2024-04-01T15:23:44.912 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 got dentry lease on test_llreadvllwritevreadonlyfile45288 dur 30000ms ttl 2024-04-01T15:24:14.825151+0000 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 put_snap_realm 0x1 0x7f0328009740 3 -> 2 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 handle_client_reply signalling caller 0x7ffc35e46830 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 handle_client_reply awaiting kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 sendrecv kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 delegated_inos: [] 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 make_request created ino 0x10000000003 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 make_request target is 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 lat 0.005781 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-04-01T15:23:44.829+0000 7f036683d480 10 break_deleg: breaking delegs on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-04-01T15:23:44.829+0000 7f036683d480 10 delegations_broken: delegations empty on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 _create_fh 0x10000000003 mode 1 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 trim_cache size 1 max 16384 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-04-01T15:23:44.829+0000 7f036683d480 8 client.4704 create(#0x1/test_llreadvllwritevreadonlyfile45288, 0100666 layout 0 0 0) = 0 2024-04-01T15:23:44.913 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 _ll_create created = 1 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-04-01T15:23:44.829+0000 7f036683d480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevreadonlyfile45288 0666 576 = 0 (0x564e0d752240 10000000003) 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 _ll_get 0x7f0328009e10 0x10000000003 -> 1 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 fill_statx on 0x10000000003 snap/devhead mode 0100666 mtime 2024-04-01T15:23:44.825116+0000 ctime 2024-04-01T15:23:44.825116+0000 change_attr 0 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-04-01T15:23:44.829+0000 7f036683d480 3 client.4704 pwritev(0x564e0d752240, "...", 14, 0) = -9 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-04-01T15:23:44.829+0000 7f036683d480 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x564e0d7c15a0 0x564e0d7c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-04-01T15:23:44.830+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- osd_op(unknown.0.0:1 3.32 3:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x564e0d7c1f60 con 0x564e0d7c15a0 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-04-01T15:23:44.830+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- osd_op(unknown.0.0:2 3.32 3:4def72d4:::10000000003.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x564e0d742da0 con 0x564e0d7c15a0 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-04-01T15:23:44.830+0000 7f0360a00640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-04-01T15:23:44.830+0000 7f0360a00640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) n = 1 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-04-01T15:23:44.830+0000 7f0363c00640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x564e0d7c15a0 0x564e0d7c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-04-01T15:23:44.830+0000 7f0363c00640 10 monclient: get_auth_request con 0x564e0d7c15a0 auth_method 0 2024-04-01T15:23:44.914 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-04-01T15:23:44.830+0000 7f0363c00640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x564e0d7c15a0 0x564e0d7c1a20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=a57a7a9d822c167 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-04-01T15:23:44.830+0000 7f0360a00640 10 client.4704 ms_handle_connect on v2:172.21.15.142:6808/3934118532 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-04-01T15:23:44.831+0000 7f0363c00640 1 -- 172.21.15.142:0/3824558164 <== osd.0 v2:172.21.15.142:6808/3934118532 1 ==== osd_op_reply(1 10000000003.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f035c05a040 con 0x564e0d7c15a0 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-04-01T15:23:44.833+0000 7f0363c00640 1 -- 172.21.15.142:0/3824558164 <== osd.0 v2:172.21.15.142:6808/3934118532 2 ==== osd_op_reply(2 10000000003.00000000 [create] v22'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f035c05a040 con 0x564e0d7c15a0 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-04-01T15:23:44.833+0000 7f036683d480 10 client.4704 get_caps 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) have pAsxLsXsxFscr need Fr want Fc revoking - 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-04-01T15:23:44.833+0000 7f036683d480 10 client.4704 _read_async 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=1} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 0~14 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-04-01T15:23:44.833+0000 7f036683d480 -1 put_cap_ref Fc went negative on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={1024=0,2048=1} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-04-01T15:23:44.834+0000 7f036683d480 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2574-gd2271579/rpm/el9/BUILD/ceph-19.0.0-2574-gd2271579/src/client/Inode.cc: In function 'int Inode::put_cap_ref(int)' thread 7f036683d480 time 2024-04-01T15:23:44.834544+0000 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2574-gd2271579/rpm/el9/BUILD/ceph-19.0.0-2574-gd2271579/src/client/Inode.cc: 207: FAILED ceph_assert(cap_refs[c] > 0) 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-2574-gd2271579 (d2271579d5e735cfd6d436b8349c004f06527cb0) squid (dev) 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0367380f3a] 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x1810f8) [0x7f03673810f8] 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (Inode::put_cap_ref(int)+0x313) [0x564e0cb5c643] 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (Client::put_cap_ref(Inode*, int)+0x32) [0x564e0cad74e2] 2024-04-01T15:23:44.915 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (Client::C_Read_Async_Finisher::finish(int)+0x21) [0x564e0cb139a1] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 6: ceph_test_client(+0xb7fad) [0x564e0ca8bfad] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (Client::_read_async(Fh*, unsigned long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0xdc) [0x564e0cb13abc] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (Client::_read(Fh*, long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0x25c) [0x564e0cb14a7c] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (Client::_preadv_pwritev_locked(Fh*, iovec const*, int, long, bool, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x10d) [0x564e0cb1acdd] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 10: (Client::ll_preadv_pwritev(Fh*, iovec const*, int, long, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x2d2) [0x564e0cb3d822] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 11: (TestClient_LlreadvLlwritevReadOnlyFile_Test::TestBody()+0x431) [0x564e0caa5091] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 12: ceph_test_client(+0x2461ec) [0x564e0cc1a1ec] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 13: (testing::Test::Run()+0xe3) [0x564e0cb85d43] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 14: ceph_test_client(+0x1d1165) [0x564e0cba5165] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 15: ceph_test_client(+0x1d12f9) [0x564e0cba52f9] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 16: (testing::internal::UnitTestImpl::RunAllTests()+0x804) [0x564e0cb97604] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 17: (testing::UnitTest::Run()+0x1a8) [0x564e0cb939a8] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 18: main() 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 19: /lib64/libc.so.6(+0x3feb0) [0x7f0366a3feb0] 2024-04-01T15:23:44.916 INFO:tasks.workunit.client.0.smithi142.stderr: 20: __libc_start_main() 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 21: _start() 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-04-01T15:23:44.834+0000 7f036683d480 -1 *** Caught signal (Aborted) ** 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f036683d480 thread_name:ceph_test_clien 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-2574-gd2271579 (d2271579d5e735cfd6d436b8349c004f06527cb0) squid (dev) 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0366a54db0] 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0366aa154c] 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0367380f94] 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x1810f8) [0x7f03673810f8] 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (Inode::put_cap_ref(int)+0x313) [0x564e0cb5c643] 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (Client::put_cap_ref(Inode*, int)+0x32) [0x564e0cad74e2] 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (Client::C_Read_Async_Finisher::finish(int)+0x21) [0x564e0cb139a1] 2024-04-01T15:23:44.917 INFO:tasks.workunit.client.0.smithi142.stderr: 10: ceph_test_client(+0xb7fad) [0x564e0ca8bfad] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 11: (Client::_read_async(Fh*, unsigned long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0xdc) [0x564e0cb13abc] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 12: (Client::_read(Fh*, long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0x25c) [0x564e0cb14a7c] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 13: (Client::_preadv_pwritev_locked(Fh*, iovec const*, int, long, bool, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x10d) [0x564e0cb1acdd] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 14: (Client::ll_preadv_pwritev(Fh*, iovec const*, int, long, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x2d2) [0x564e0cb3d822] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 15: (TestClient_LlreadvLlwritevReadOnlyFile_Test::TestBody()+0x431) [0x564e0caa5091] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 16: ceph_test_client(+0x2461ec) [0x564e0cc1a1ec] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 17: (testing::Test::Run()+0xe3) [0x564e0cb85d43] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 18: ceph_test_client(+0x1d1165) [0x564e0cba5165] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 19: ceph_test_client(+0x1d12f9) [0x564e0cba52f9] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 20: (testing::internal::UnitTestImpl::RunAllTests()+0x804) [0x564e0cb97604] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 21: (testing::UnitTest::Run()+0x1a8) [0x564e0cb939a8] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 22: main() 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 23: /lib64/libc.so.6(+0x3feb0) [0x7f0366a3feb0] 2024-04-01T15:23:44.918 INFO:tasks.workunit.client.0.smithi142.stderr: 24: __libc_start_main() 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 25: _start() 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-04-01T15:23:44.919 INFO:tasks.workunit.client.0.smithi142.stderr: 3/ 5 mds_quiesce 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-04-01T15:23:44.920 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 client 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 ms 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-04-01T15:23:44.921 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-04-01T15:23:44.922 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_notification 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-04-01T15:23:44.923 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-04-01T15:23:44.924 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-04-01T15:23:44.925 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0358a00640 / safe_timer 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0359400640 / ceph_test_clien 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr: 7f035a800640 / msgr-worker-2 2024-04-01T15:23:44.926 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0360a00640 / ms_dispatch 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0361e00640 / ceph_timer 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0362800640 / io_context_pool 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0363200640 / msgr-worker-1 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0363c00640 / msgr-worker-0 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: 7f036683d480 / ceph_test_clien 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/log/ceph/ceph-client.admin.45288.log 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.927 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.928 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-04-01T15:23:44.793+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-04-01T15:23:44.794+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-04-01T15:23:44.794+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-04-01T15:23:44.794+0000 7f036683d480 10 monclient: build_initial_monmap 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-04-01T15:23:44.794+0000 7f036683d480 1 build_initial for_mkfs: 0 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-04-01T15:23:44.794+0000 7f036683d480 10 monclient: monmap: 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-04-01T15:23:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.noname-c 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-04-01T15:23:44.794+0000 7f036683d480 10 monclient: init 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding auth protocol: cephx 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding auth protocol: cephx 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding auth protocol: cephx 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.930 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: crc 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-04-01T15:23:44.794+0000 7f036683d480 5 AuthRegistry(0x564e0d87dc60) adding con mode: secure 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-04-01T15:23:44.795+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-04-01T15:23:44.795+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.931 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-04-01T15:23:44.795+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.932 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-04-01T15:23:44.795+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command rotate-key hook 0x564e0d87dda8 2024-04-01T15:23:44.932 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-04-01T15:23:44.796+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command objecter_requests hook 0x564e0d873ef0 2024-04-01T15:23:44.932 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient: _renew_subs 2024-04-01T15:23:44.932 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient: _reopen_session rank -1 2024-04-01T15:23:44.932 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient: _add_conns ranks=[0,2,1] 2024-04-01T15:23:44.932 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-04-01T15:23:44.796+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.932 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): picked mon.noname-a con 0x564e0d71f2f0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-04-01T15:23:44.932 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-04-01T15:23:44.796+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.932 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): picked mon.noname-c con 0x564e0d876090 addr [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-04-01T15:23:44.796+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): picked mon.noname-b con 0x564e0d879a90 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-04-01T15:23:44.796+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0330006db0 con 0x564e0d71f2f0 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-04-01T15:23:44.796+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d875cd0 con 0x564e0d879a90 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-04-01T15:23:44.796+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d875e80 con 0x564e0d876090 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-04-01T15:23:44.796+0000 7f036683d480 10 monclient(hunting): _renew_subs 2024-04-01T15:23:44.933 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-04-01T15:23:44.796+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-04-01T15:23:44.796+0000 7f0363200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53042/0 (socket says 172.21.15.142:53042) 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-04-01T15:23:44.796+0000 7f035a800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-04-01T15:23:44.796+0000 7f0363c00640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): get_auth_request con 0x564e0d876090 auth_method 0 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-04-01T15:23:44.796+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 learned_addr learned my addr 172.21.15.142:0/3596921880 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): get_auth_request con 0x564e0d71f2f0 auth_method 0 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.934 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): get_auth_request con 0x564e0d879a90 auth_method 0 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command mds_requests hook 0x564e0d7c0df8 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command mds_sessions hook 0x564e0d7c0df8 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command dump_cache hook 0x564e0d7c0df8 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command kick_stale_sessions hook 0x564e0d7c0df8 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-04-01T15:23:44.797+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command status hook 0x564e0d7c0df8 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-04-01T15:23:44.797+0000 7f036683d480 10 monclient(hunting): authenticate will time out at 1352.886274s 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-04-01T15:23:44.797+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-01T15:23:44.935 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-04-01T15:23:44.797+0000 7f0363c00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient(hunting): handle_auth_done global_id 4701 payload 653 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-04-01T15:23:44.797+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 msgr2=0x564e0d74b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-04-01T15:23:44.797+0000 7f0363200640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-04-01T15:23:44.797+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 msgr2=0x564e0d7daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-04-01T15:23:44.797+0000 7f0363200640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient: _finish_hunting 0 2024-04-01T15:23:44.936 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-04-01T15:23:44.797+0000 7f0363200640 1 monclient: found mon.noname-a 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-04-01T15:23:44.797+0000 7f0363200640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-04-01T15:23:44.797+0000 7f0363200640 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d7098c0 con 0x564e0d71f2f0 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-04-01T15:23:44.798+0000 7f0363200640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x564e0d7d03d0 tx=0x7f0354019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3e884ddfd3ae25 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-04-01T15:23:44.798+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035404e080 con 0x564e0d71f2f0 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: handle_monmap mon_map magic: 0 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: dump: 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-04-01T15:20:53.018049+0000 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-04-01T15:20:53.018049+0000 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-04-01T15:23:44.937 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: _finish_auth 0 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: _check_auth_tickets 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-04-01T15:23:44.798+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0354046bf0 con 0x564e0d71f2f0 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-04-01T15:23:44.798+0000 7f036683d480 5 monclient: authenticate success, global_id 4701 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-04-01T15:23:44.798+0000 7f036683d480 10 client.4701 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-04-01T15:23:44.798+0000 7f036683d480 10 monclient: _renew_subs 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-04-01T15:23:44.798+0000 7f036683d480 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-04-01T15:23:44.798+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x564e0d873b20 con 0x564e0d71f2f0 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 tick 2024-04-01T15:23:44.938 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 collect_and_send_metrics 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 collect_and_send_global_metrics 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-04-01T15:23:44.798+0000 7f0358a00640 5 client.4701 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-04-01T15:23:44.798+0000 7f0358a00640 20 client.4701 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-04-01T15:23:44.798+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564e0d712dd0 con 0x564e0d71f2f0 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-04-01T15:23:44.798+0000 7f0361e00640 10 monclient: handle_config config(0 keys) 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-04-01T15:23:44.799+0000 7f0362800640 4 set_mon_vals no callback set 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-04-01T15:23:44.799+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f0354046df0 con 0x564e0d71f2f0 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-04-01T15:23:44.799+0000 7f0361e00640 1 client.4701 handle_mds_map epoch 8 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-04-01T15:23:44.799+0000 7f036683d480 20 client.4701 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-04-01T15:23:44.799+0000 7f036683d480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-04-01T15:23:44.799+0000 7f036683d480 20 client.4701 mds is 0 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-04-01T15:23:44.799+0000 7f036683d480 10 client.4701 _open_mds_session mds.0 2024-04-01T15:23:44.939 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-04-01T15:23:44.799+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-04-01T15:23:44.799+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-04-01T15:23:44.799+0000 7f036683d480 10 client.4701 waiting for session to mds.0 to open 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-04-01T15:23:44.799+0000 7f035a800640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-04-01T15:23:44.799+0000 7f035a800640 10 monclient: get_auth_request con 0x564e0d879fc0 auth_method 0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-04-01T15:23:44.800+0000 7f0361e00640 10 client.4701 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-04-01T15:23:44.800+0000 7f035a800640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc1be271e514939 server_cookie=b3df367d376abe79 in_seq=0 out_seq=0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-04-01T15:23:44.807+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d705ff0 con 0x564e0d879fc0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-04-01T15:23:44.807+0000 7f0361e00640 10 client.4701 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-04-01T15:23:44.807+0000 7f0361e00640 10 client.4701 renew_caps mds.0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-04-01T15:23:44.807+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f033000a830 con 0x564e0d879fc0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-04-01T15:23:44.807+0000 7f0361e00640 10 client.4701 connect_mds_targets for mds.0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-04-01T15:23:44.807+0000 7f036683d480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 mds is 0 2024-04-01T15:23:44.940 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-04-01T15:23:44.807+0000 7f036683d480 10 client.4701 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 encode_cap_releases enter (req: 0x564e0d7e0260, mds: 0) 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 send_request set sent_stamp to 2024-04-01T15:23:44.808710+0000 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-04-01T15:23:44.807+0000 7f036683d480 10 client.4701 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.800193+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-04-01T15:23:44.807+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.800193+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d74e460 con 0x564e0d879fc0 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-04-01T15:23:44.807+0000 7f036683d480 20 client.4701 awaiting reply|forward|kick on 0x7ffc35e46ce0 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-04-01T15:23:44.808+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f033000a830 con 0x564e0d879fc0 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-04-01T15:23:44.808+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f034c005df0 con 0x564e0d879fc0 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 insert_trace from 2024-04-01T15:23:44.808710+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 features 0xffffffffffffffff 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 update_snap_trace len 70 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0x7f03300058a0, nref now is 1 2024-04-01T15:23:44.941 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-04-01T15:23:44.808+0000 7f0361e00640 15 client.4701 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-04-01T15:23:44.808+0000 7f0361e00640 15 client.4701 snapc 1=[] 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_snap_realm 0x1 0x7f03300058a0 2 -> 1 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f033000aa50) - ctime 2024-04-01T15:23:44.777429+0000 mtime 2024-04-01T15:23:44.777429+0000 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 dir hash is 2 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-04-01T15:23:44.808+0000 7f0361e00640 12 client.4701 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-04-01T15:23:44.808+0000 7f0361e00640 12 client.4701 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- has_dir_layout 0x7f033000aa50) caps pAsLsXsFs 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0x7f03300058a0, nref was 1 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 get_snap_realm 0x1 0x7f03300058a0, nref now is 2 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-04-01T15:23:44.808+0000 7f0361e00640 15 client.4701 add_update_cap first one, opened snaprealm 0x7f03300058a0 2024-04-01T15:23:44.942 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_snap_realm 0x1 0x7f03300058a0 2 -> 1 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 handle_client_reply signalling caller 0x7ffc35e46ce0 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 handle_client_reply awaiting kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 sendrecv kickback on tid 1 0x7f0361dfde80 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 lat 0.001148 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 _ll_get 0x7f033000aa50 0x1 -> 1 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 unmount 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size was 0+1 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-04-01T15:23:44.808+0000 7f0361e00640 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-04-01T15:23:44.808+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size still 0+1 2024-04-01T15:23:44.943 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 unmounting 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _ll_drop_pins 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 _ll_put 0x7f033000aa50 0x1 1 -> 0 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 nothing to flush 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 1 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 flush_caps_sync 2024-04-01T15:23:44.944 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) n = 8 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-04-01T15:23:44.808+0000 7f036683d480 15 client.4701 remove_cap last one, closing snaprealm 0x7f03300058a0 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-04-01T15:23:44.808+0000 7f036683d480 20 client.4701 put_snap_realm 0x1 0x7f03300058a0 1 -> 0 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-04-01T15:23:44.808+0000 7f036683d480 10 client.4701 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- COMPLETE has_dir_layout 0x7f033000aa50) 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 _close_mds_session mds.0 seq 0 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-04-01T15:23:44.808+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_close) -- 0x564e0d880910 con 0x564e0d879fc0 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-04-01T15:23:44.808+0000 7f036683d480 2 client.4701 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-04-01T15:23:44.812+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x564e0d880910 con 0x564e0d879fc0 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 handle_client_session client_session(close) from mds.0 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-04-01T15:23:44.812+0000 7f0361e00640 5 client.4701 _closed_mds_session mds.0 seq 0 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-04-01T15:23:44.812+0000 7f0361e00640 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 msgr2=0x564e0d751e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-04-01T15:23:44.812+0000 7f0361e00640 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.945 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 remove_session_caps mds.0 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 kick_requests_closed for mds.0 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size was 0+0 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-04-01T15:23:44.812+0000 7f0361e00640 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-04-01T15:23:44.812+0000 7f0361e00640 10 client.4701 unmounting: trim pass, size still 0+0 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-04-01T15:23:44.812+0000 7f036683d480 2 client.4701 unmounted. 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-04-01T15:23:44.812+0000 7f036683d480 1 client.4701 shutdown 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands dump_cache 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands kick_stale_sessions 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands mds_requests 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands mds_sessions 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands status 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands objecter_requests 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-04-01T15:23:44.812+0000 7f036683d480 10 monclient: shutdown 2024-04-01T15:23:44.946 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-04-01T15:23:44.812+0000 7f036683d480 5 asok(0x564e0d6bc8c0) unregister_commands rotate-key 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-04-01T15:23:44.812+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 msgr2=0x564e0d7dcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-04-01T15:23:44.812+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x564e0d7d03d0 tx=0x7f0354019000 comp rx=0 tx=0).stop 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 shutdown_connections 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d751e00 unknown :-1 s=CLOSED pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d876090 0x564e0d74b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-04-01T15:23:44.813+0000 7f036683d480 1 --2- 172.21.15.142:0/3596921880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d71f2f0 0x564e0d7dcdf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 >> 172.21.15.142:0/3596921880 conn(0x564e0d750560 msgr2=0x564e0d7515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 shutdown_connections 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-04-01T15:23:44.813+0000 7f036683d480 1 -- 172.21.15.142:0/3596921880 wait complete. 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-04-01T15:23:44.813+0000 7f036683d480 20 client.4701 trim_cache size 0 max 16384 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding auth protocol: cephx 2024-04-01T15:23:44.947 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: crc 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-04-01T15:23:44.813+0000 7f036683d480 5 AuthRegistry(0x564e0d74aa70) adding con mode: secure 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-04-01T15:23:44.814+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-04-01T15:23:44.814+0000 7f036683d480 1 -- start start 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-04-01T15:23:44.814+0000 7f036683d480 10 monclient: build_initial_monmap 2024-04-01T15:23:44.948 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-04-01T15:23:44.814+0000 7f036683d480 1 build_initial for_mkfs: 0 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-04-01T15:23:44.814+0000 7f036683d480 10 monclient: monmap: 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.noname-c 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-04-01T15:23:44.814+0000 7f036683d480 10 monclient: init 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding auth protocol: cephx 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding auth protocol: cephx 2024-04-01T15:23:44.949 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding auth protocol: cephx 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: crc 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-04-01T15:23:44.814+0000 7f036683d480 5 AuthRegistry(0x564e0d7131c0) adding con mode: secure 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-04-01T15:23:44.814+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-04-01T15:23:44.815+0000 7f036683d480 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-01T15:23:44.950 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-04-01T15:23:44.815+0000 7f036683d480 1 Processor -- start 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-04-01T15:23:44.815+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command rotate-key hook 0x564e0d713308 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-04-01T15:23:44.815+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command objecter_requests hook 0x564e0d7e0ca0 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient: _renew_subs 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient: _reopen_session rank -1 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient: _add_conns ranks=[1,0,2] 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-04-01T15:23:44.815+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 0x564e0d74b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): picked mon.noname-b con 0x564e0d71f2f0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-04-01T15:23:44.815+0000 7f036683d480 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): picked mon.noname-a con 0x564e0d876090 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-04-01T15:23:44.815+0000 7f036683d480 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): picked mon.noname-c con 0x564e0d879a90 addr [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-04-01T15:23:44.815+0000 7f036683d480 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0330007bc0 con 0x564e0d876090 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.951 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-04-01T15:23:44.815+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564e0d874e50 con 0x564e0d71f2f0 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): start opening mon connection 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-04-01T15:23:44.815+0000 7f036683d480 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564e0d876470 con 0x564e0d879a90 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-04-01T15:23:44.815+0000 7f036683d480 10 monclient(hunting): _renew_subs 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53044/0 (socket says 172.21.15.142:53044) 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 learned_addr learned my addr 172.21.15.142:0/3824558164 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): get_auth_request con 0x564e0d876090 auth_method 0 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-04-01T15:23:44.816+0000 7f0363200640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 0x564e0d74b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-04-01T15:23:44.816+0000 7f0363c00640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-04-01T15:23:44.816+0000 7f0363200640 10 monclient(hunting): get_auth_request con 0x564e0d71f2f0 auth_method 0 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-04-01T15:23:44.816+0000 7f0363200640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-04-01T15:23:44.816+0000 7f0363200640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-04-01T15:23:44.816+0000 7f0363200640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-04-01T15:23:44.816+0000 7f0363c00640 10 monclient(hunting): get_auth_request con 0x564e0d879a90 auth_method 0 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-04-01T15:23:44.816+0000 7f0363c00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-04-01T15:23:44.816+0000 7f0363c00640 10 monclient(hunting): _init_auth method 2 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command mds_requests hook 0x564e0d7c0df8 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-04-01T15:23:44.816+0000 7f0363c00640 10 monclient(hunting): _init_auth creating new auth 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command mds_sessions hook 0x564e0d7c0df8 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command dump_cache hook 0x564e0d7c0df8 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient(hunting): handle_auth_done global_id 4704 payload 653 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command kick_stale_sessions hook 0x564e0d7c0df8 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-04-01T15:23:44.816+0000 7f036683d480 5 asok(0x564e0d6bc8c0) register_command status hook 0x564e0d7c0df8 2024-04-01T15:23:44.953 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 msgr2=0x564e0d7daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e0d879a90 0x564e0d7daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 msgr2=0x564e0d74b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-04-01T15:23:44.816+0000 7f035a800640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e0d71f2f0 0x564e0d74b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient: _finish_hunting 0 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-04-01T15:23:44.816+0000 7f035a800640 1 monclient: found mon.noname-a 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-04-01T15:23:44.816+0000 7f035a800640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-04-01T15:23:44.816+0000 7f035a800640 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0d71bbb0 con 0x564e0d876090 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-04-01T15:23:44.816+0000 7f036683d480 5 monclient: already authenticated 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-04-01T15:23:44.816+0000 7f036683d480 10 client.4704 Subscribing to map 'mdsmap' 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-04-01T15:23:44.816+0000 7f036683d480 10 monclient: _renew_subs 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-04-01T15:23:44.816+0000 7f036683d480 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-04-01T15:23:44.816+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mdsmap=0+}) -- 0x564e0d86cb80 con 0x564e0d876090 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 tick 2024-04-01T15:23:44.954 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 collect_and_send_metrics 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 collect_and_send_global_metrics 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-04-01T15:23:44.816+0000 7f0359400640 5 client.4704 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 trim_cache size 0 max 16384 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-04-01T15:23:44.816+0000 7f0359400640 20 client.4704 upkeep thread waiting interval 1.000000000s 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-04-01T15:23:44.817+0000 7f035a800640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e0d876090 0x564e0d7dcdf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f034c005870 tx=0x7f034c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792a801bc5d920a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 client.4704 ms_handle_connect on v2:172.21.15.142:3300/0 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-04-01T15:23:44.817+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c007ca0 con 0x564e0d876090 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: handle_monmap mon_map magic: 0 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: dump: 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-04-01T15:20:53.018049+0000 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-04-01T15:20:53.018049+0000 2024-04-01T15:23:44.955 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: _finish_auth 0 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-04-01T15:23:44.817+0000 7f0360a00640 10 monclient: _check_auth_tickets 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-04-01T15:23:44.817+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f034c046b30 con 0x564e0d876090 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-04-01T15:23:44.817+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mdsmap(e 8) ==== 1240+0+0 (secure 0 0 0) 0x7f034c041030 con 0x564e0d876090 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-04-01T15:23:44.817+0000 7f0360a00640 1 client.4704 handle_mds_map epoch 8 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-04-01T15:23:44.817+0000 7f036683d480 20 client.4704 populate_metadata read hostname 'smithi142' 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-04-01T15:23:44.817+0000 7f036683d480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-04-01T15:23:44.817+0000 7f036683d480 20 client.4704 mds is 0 2024-04-01T15:23:44.956 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-04-01T15:23:44.817+0000 7f036683d480 10 client.4704 _open_mds_session mds.0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-04-01T15:23:44.817+0000 7f036683d480 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d7515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-04-01T15:23:44.817+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_open) -- 0x564e0d880b60 con 0x564e0d879fc0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-04-01T15:23:44.817+0000 7f036683d480 10 client.4704 waiting for session to mds.0 to open 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-04-01T15:23:44.818+0000 7f0363200640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d7515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-04-01T15:23:44.818+0000 7f0363200640 10 monclient: get_auth_request con 0x564e0d879fc0 auth_method 0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-04-01T15:23:44.819+0000 7f0363200640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] conn(0x564e0d879fc0 0x564e0d7515d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d049c6eff623b784 server_cookie=ff503aa4db373ab8 in_seq=0 out_seq=0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-04-01T15:23:44.819+0000 7f0360a00640 10 client.4704 ms_handle_connect on v2:172.21.15.179:6834/1191595510 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-04-01T15:23:44.822+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x564e0d880b60 con 0x564e0d879fc0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-04-01T15:23:44.822+0000 7f0360a00640 10 client.4704 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-04-01T15:23:44.822+0000 7f0360a00640 10 client.4704 renew_caps mds.0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-04-01T15:23:44.822+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_session(request_renewcaps seq 1) -- 0x7f0328009520 con 0x564e0d879fc0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-04-01T15:23:44.822+0000 7f0360a00640 10 client.4704 connect_mds_targets for mds.0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-04-01T15:23:44.822+0000 7f036683d480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 mds is 0 2024-04-01T15:23:44.957 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-04-01T15:23:44.822+0000 7f036683d480 10 client.4704 send_request rebuilding request 1 for mds.0 2024-04-01T15:23:44.958 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 encode_cap_releases enter (req: 0x564e0d7d61a0, mds: 0) 2024-04-01T15:23:44.958 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 send_request set sent_stamp to 2024-04-01T15:23:44.823936+0000 2024-04-01T15:23:44.958 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-04-01T15:23:44.822+0000 7f036683d480 10 client.4704 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.818750+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.958 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-04-01T15:23:44.822+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-01T15:23:44.818750+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d751d90 con 0x564e0d879fc0 2024-04-01T15:23:44.958 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-04-01T15:23:44.822+0000 7f036683d480 20 client.4704 awaiting reply|forward|kick on 0x7ffc35e469f0 2024-04-01T15:23:44.958 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-04-01T15:23:44.823+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f0328009520 con 0x564e0d879fc0 2024-04-01T15:23:44.958 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-01T15:23:44.958 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-04-01T15:23:44.823+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f035401e070 con 0x564e0d879fc0 2024-04-01T15:23:44.958 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 1 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 insert_trace from 2024-04-01T15:23:44.823936+0000 mds.0 is_target=1 is_dentry=0 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 features 0xffffffffffffffff 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 update_snap_trace len 70 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0, nref was 0 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 1 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-04-01T15:23:44.823+0000 7f0360a00640 15 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) self|parent updated 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-04-01T15:23:44.823+0000 7f0360a00640 15 client.4704 snapc 1=[] 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 put_snap_realm 0x1 0x7f0328009740 2 -> 1 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 hrm is_target=1 is_dentry=0 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f0328009830) - ctime 2024-04-01T15:23:44.777429+0000 mtime 2024-04-01T15:23:44.777429+0000 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 dir hash is 2 2024-04-01T15:23:44.959 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-04-01T15:23:44.823+0000 7f0360a00640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-04-01T15:23:44.823+0000 7f0360a00640 12 client.4704 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=- has_dir_layout 0x7f0328009830) caps pAsLsXsFs 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref was 1 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 2 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-04-01T15:23:44.823+0000 7f0360a00640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f0328009740 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-04-01T15:23:44.823+0000 7f0360a00640 10 client.4704 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 put_snap_realm 0x1 0x7f0328009740 2 -> 1 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 handle_client_reply signalling caller 0x7ffc35e469f0 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-04-01T15:23:44.823+0000 7f0360a00640 20 client.4704 handle_client_reply awaiting kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.960 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-04-01T15:23:44.823+0000 7f036683d480 20 client.4704 sendrecv kickback on tid 1 0x7f03609fde80 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-04-01T15:23:44.823+0000 7f036683d480 20 client.4704 lat 0.001097 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-04-01T15:23:44.823+0000 7f036683d480 20 client.4704 _ll_get 0x7f0328009830 0x1 -> 1 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-04-01T15:23:44.823+0000 7f036683d480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevreadonlyfile45288 0666 576, uid 0, gid 0 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-04-01T15:23:44.823+0000 7f036683d480 10 client.4704 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) dn 'test_llreadvllwritevreadonlyfile45288' 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830); UserPerm(uid: 0, gid: 0) 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 _getattr mask As issued=1 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-04-01T15:23:44.824+0000 7f036683d480 3 client.4704 may_create 0x7f0328009830 = 0 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-04-01T15:23:44.824+0000 7f036683d480 8 client.4704 _create(0x1 test_llreadvllwritevreadonlyfile45288, 0666) 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) name test_llreadvllwritevreadonlyfile45288 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-04-01T15:23:44.824+0000 7f036683d480 15 open_dir 0x564e0d751bf0 on 0x7f0328009830 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-04-01T15:23:44.824+0000 7f036683d480 15 client.4704 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) 'test_llreadvllwritevreadonlyfile45288' dn 0x1.head["test_llreadvllwritevreadonlyfile45288"] (new dn) 2024-04-01T15:23:44.961 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.962 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 choose_target_mds inode dir hash is 2 on test_llreadvllwritevreadonlyfile45288 => 3886579998 2024-04-01T15:23:44.962 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) is_hash=1 hash=3886579998 2024-04-01T15:23:44.962 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.962 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 mds is 0 2024-04-01T15:23:44.962 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 send_request rebuilding request 2 for mds.0 2024-04-01T15:23:44.962 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 encode_cap_releases enter (req: 0x564e0d751d90, mds: 0) 2024-04-01T15:23:44.962 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 encode_dentry_release enter(dn:0x7f033000a740) 2024-04-01T15:23:44.962 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f0328009830), req:0x564e0d751d90 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-01T15:23:44.962 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 send_request set sent_stamp to 2024-04-01T15:23:44.825151+0000 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-04-01T15:23:44.824+0000 7f036683d480 10 client.4704 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile45288 2024-04-01T15:23:44.825116+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-04-01T15:23:44.824+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.179:6834/1191595510,v1:172.21.15.179:6835/1191595510] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile45288 2024-04-01T15:23:44.825116+0000 caller_uid=0, caller_gid=0{}) -- 0x564e0d889660 con 0x564e0d879fc0 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-04-01T15:23:44.824+0000 7f036683d480 20 client.4704 awaiting reply|forward|kick on 0x7ffc35e46830 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-04-01T15:23:44.824+0000 7f0360a00640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) n = 1 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-04-01T15:23:44.824+0000 7f0360a00640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) n = 1 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-04-01T15:23:44.829+0000 7f0360a00640 1 -- 172.21.15.142:0/3824558164 <== mds.0 v2:172.21.15.179:6834/1191595510 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 858+0+0 (crc 0 0 0) 0x7f0354017250 con 0x564e0d879fc0 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 2 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 insert_trace from 2024-04-01T15:23:44.825151+0000 mds.0 is_target=1 is_dentry=1 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 features 0xffffffffffffffff 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_snap_trace len 70 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref was 1 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 2 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-01T15:21:58.495582+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-01T15:23:44.963 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 hrm is_target=1 is_dentry=1 2024-04-01T15:23:44.964 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_inode_file_time 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f0328009e10) - ctime 2024-04-01T15:23:44.825116+0000 mtime 2024-04-01T15:23:44.825116+0000 2024-04-01T15:23:44.964 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-01T15:23:44.964 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode adding 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f0328009e10) caps pAsxLsXsxFscr 2024-04-01T15:23:44.964 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref was 2 2024-04-01T15:23:44.964 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 get_snap_realm 0x1 0x7f0328009740, nref now is 3 2024-04-01T15:23:44.964 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-04-01T15:23:44.829+0000 7f0360a00640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f0328009740 2024-04-01T15:23:44.964 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 add_update_cap issued - -> pAsxLsXsxFscr from mds.0 on 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f0328009e10) 2024-04-01T15:23:44.964 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 add_update_cap calling signal_caps_inode 2024-04-01T15:23:44.964 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) caps pAsLsXs 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.777429+0000 ctime=2024-04-01T15:23:44.777429+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) pAsLsXs ctime 2024-04-01T15:23:44.825116+0000 mtime 2024-04-01T15:23:44.825116+0000 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 dir hash is 2 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 add_update_inode client inode change_attr: 6 , mds inodestat change_attr: 7 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 got dirfrag map for 0x1 frag * to mds 0 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-04-01T15:23:44.829+0000 7f0360a00640 12 client.4704 insert_dentry_inode 'test_llreadvllwritevreadonlyfile45288' vino 0x10000000003.head in dir 0x1.head dn 0x7f033000a740 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-04-01T15:23:44.829+0000 7f0360a00640 15 client.4704 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) 'test_llreadvllwritevreadonlyfile45288' to inode 0x7f0328009e10 dn 0x1.head["test_llreadvllwritevreadonlyfile45288"] (old dn) 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 link inode 0x7f0328009e10 parents now 0x1.head["test_llreadvllwritevreadonlyfile45288"] 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-04-01T15:23:44.829+0000 7f0360a00640 15 client.4704 update_dentry_lease 0x1.head["test_llreadvllwritevreadonlyfile45288"] lease(mask 7 dur 30000) from 2024-04-01T15:23:44.825151+0000 2024-04-01T15:23:44.965 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-04-01T15:23:44.829+0000 7f0360a00640 10 client.4704 got dentry lease on test_llreadvllwritevreadonlyfile45288 dur 30000ms ttl 2024-04-01T15:24:14.825151+0000 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 put_snap_realm 0x1 0x7f0328009740 3 -> 2 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 handle_client_reply signalling caller 0x7ffc35e46830 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-04-01T15:23:44.829+0000 7f0360a00640 20 client.4704 handle_client_reply awaiting kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 sendrecv kickback on tid 2 0x7f03609fde80 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 delegated_inos: [] 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 make_request created ino 0x10000000003 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 make_request target is 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 lat 0.005781 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-04-01T15:23:44.829+0000 7f036683d480 10 break_deleg: breaking delegs on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.966 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-04-01T15:23:44.829+0000 7f036683d480 10 delegations_broken: delegations empty on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 _create_fh 0x10000000003 mode 1 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 trim_cache size 1 max 16384 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-04-01T15:23:44.829+0000 7f036683d480 8 client.4704 create(#0x1/test_llreadvllwritevreadonlyfile45288, 0100666 layout 0 0 0) = 0 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 _ll_create created = 1 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-04-01T15:23:44.829+0000 7f036683d480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevreadonlyfile45288 0666 576 = 0 (0x564e0d752240 10000000003) 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 _ll_get 0x7f0328009e10 0x10000000003 -> 1 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-04-01T15:23:44.829+0000 7f036683d480 10 client.4704 fill_statx on 0x10000000003 snap/devhead mode 0100666 mtime 2024-04-01T15:23:44.825116+0000 ctime 2024-04-01T15:23:44.825116+0000 change_attr 0 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-04-01T15:23:44.829+0000 7f036683d480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.967 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-04-01T15:23:44.829+0000 7f036683d480 3 client.4704 pwritev(0x564e0d752240, "...", 14, 0) = -9 2024-04-01T15:23:44.968 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-04-01T15:23:44.829+0000 7f036683d480 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x564e0d7c15a0 0x564e0d7c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:44.968 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-04-01T15:23:44.830+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- osd_op(unknown.0.0:1 3.32 3:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x564e0d7c1f60 con 0x564e0d7c15a0 2024-04-01T15:23:44.968 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-04-01T15:23:44.830+0000 7f036683d480 1 -- 172.21.15.142:0/3824558164 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- osd_op(unknown.0.0:2 3.32 3:4def72d4:::10000000003.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x564e0d742da0 con 0x564e0d7c15a0 2024-04-01T15:23:44.968 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-04-01T15:23:44.830+0000 7f0360a00640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) n = 1 2024-04-01T15:23:44.968 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-04-01T15:23:44.830+0000 7f0360a00640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-01T15:21:58.495582+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f0328009830) n = 1 2024-04-01T15:23:44.968 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-04-01T15:23:44.830+0000 7f0363c00640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x564e0d7c15a0 0x564e0d7c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:44.968 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-04-01T15:23:44.830+0000 7f0363c00640 10 monclient: get_auth_request con 0x564e0d7c15a0 auth_method 0 2024-04-01T15:23:44.969 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-04-01T15:23:44.830+0000 7f0363c00640 1 --2- 172.21.15.142:0/3824558164 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x564e0d7c15a0 0x564e0d7c1a20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=a57a7a9d822c167 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:44.969 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-04-01T15:23:44.830+0000 7f0360a00640 10 client.4704 ms_handle_connect on v2:172.21.15.142:6808/3934118532 2024-04-01T15:23:44.969 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-04-01T15:23:44.831+0000 7f0363c00640 1 -- 172.21.15.142:0/3824558164 <== osd.0 v2:172.21.15.142:6808/3934118532 1 ==== osd_op_reply(1 10000000003.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f035c05a040 con 0x564e0d7c15a0 2024-04-01T15:23:44.969 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-04-01T15:23:44.833+0000 7f0363c00640 1 -- 172.21.15.142:0/3824558164 <== osd.0 v2:172.21.15.142:6808/3934118532 2 ==== osd_op_reply(2 10000000003.00000000 [create] v22'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f035c05a040 con 0x564e0d7c15a0 2024-04-01T15:23:44.969 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-04-01T15:23:44.833+0000 7f036683d480 10 client.4704 get_caps 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) have pAsxLsXsxFscr need Fr want Fc revoking - 2024-04-01T15:23:44.969 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-04-01T15:23:44.833+0000 7f036683d480 10 client.4704 _read_async 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=1} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 0~14 2024-04-01T15:23:44.969 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-04-01T15:23:44.833+0000 7f036683d480 -1 put_cap_ref Fc went negative on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={1024=0,2048=1} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-01T15:23:44.825116+0000 mtime=2024-04-01T15:23:44.825116+0000 ctime=2024-04-01T15:23:44.825116+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile45288"] 0x7f0328009e10) 2024-04-01T15:23:44.969 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-04-01T15:23:44.834+0000 7f036683d480 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2574-gd2271579/rpm/el9/BUILD/ceph-19.0.0-2574-gd2271579/src/client/Inode.cc: In function 'int Inode::put_cap_ref(int)' thread 7f036683d480 time 2024-04-01T15:23:44.834544+0000 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2574-gd2271579/rpm/el9/BUILD/ceph-19.0.0-2574-gd2271579/src/client/Inode.cc: 207: FAILED ceph_assert(cap_refs[c] > 0) 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-2574-gd2271579 (d2271579d5e735cfd6d436b8349c004f06527cb0) squid (dev) 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0367380f3a] 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x1810f8) [0x7f03673810f8] 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (Inode::put_cap_ref(int)+0x313) [0x564e0cb5c643] 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (Client::put_cap_ref(Inode*, int)+0x32) [0x564e0cad74e2] 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (Client::C_Read_Async_Finisher::finish(int)+0x21) [0x564e0cb139a1] 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr: 6: ceph_test_client(+0xb7fad) [0x564e0ca8bfad] 2024-04-01T15:23:44.970 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (Client::_read_async(Fh*, unsigned long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0xdc) [0x564e0cb13abc] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (Client::_read(Fh*, long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0x25c) [0x564e0cb14a7c] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (Client::_preadv_pwritev_locked(Fh*, iovec const*, int, long, bool, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x10d) [0x564e0cb1acdd] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 10: (Client::ll_preadv_pwritev(Fh*, iovec const*, int, long, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x2d2) [0x564e0cb3d822] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 11: (TestClient_LlreadvLlwritevReadOnlyFile_Test::TestBody()+0x431) [0x564e0caa5091] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 12: ceph_test_client(+0x2461ec) [0x564e0cc1a1ec] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 13: (testing::Test::Run()+0xe3) [0x564e0cb85d43] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 14: ceph_test_client(+0x1d1165) [0x564e0cba5165] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 15: ceph_test_client(+0x1d12f9) [0x564e0cba52f9] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 16: (testing::internal::UnitTestImpl::RunAllTests()+0x804) [0x564e0cb97604] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 17: (testing::UnitTest::Run()+0x1a8) [0x564e0cb939a8] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 18: main() 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 19: /lib64/libc.so.6(+0x3feb0) [0x7f0366a3feb0] 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 20: __libc_start_main() 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 21: _start() 2024-04-01T15:23:44.971 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-04-01T15:23:44.834+0000 7f036683d480 -1 *** Caught signal (Aborted) ** 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f036683d480 thread_name:ceph_test_clien 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-2574-gd2271579 (d2271579d5e735cfd6d436b8349c004f06527cb0) squid (dev) 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0366a54db0] 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0366aa154c] 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0367380f94] 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x1810f8) [0x7f03673810f8] 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (Inode::put_cap_ref(int)+0x313) [0x564e0cb5c643] 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (Client::put_cap_ref(Inode*, int)+0x32) [0x564e0cad74e2] 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (Client::C_Read_Async_Finisher::finish(int)+0x21) [0x564e0cb139a1] 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 10: ceph_test_client(+0xb7fad) [0x564e0ca8bfad] 2024-04-01T15:23:44.972 INFO:tasks.workunit.client.0.smithi142.stderr: 11: (Client::_read_async(Fh*, unsigned long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0xdc) [0x564e0cb13abc] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 12: (Client::_read(Fh*, long, unsigned long, ceph::buffer::v15_2_0::list*, Context*)+0x25c) [0x564e0cb14a7c] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 13: (Client::_preadv_pwritev_locked(Fh*, iovec const*, int, long, bool, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x10d) [0x564e0cb1acdd] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 14: (Client::ll_preadv_pwritev(Fh*, iovec const*, int, long, bool, Context*, ceph::buffer::v15_2_0::list*, bool, bool)+0x2d2) [0x564e0cb3d822] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 15: (TestClient_LlreadvLlwritevReadOnlyFile_Test::TestBody()+0x431) [0x564e0caa5091] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 16: ceph_test_client(+0x2461ec) [0x564e0cc1a1ec] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 17: (testing::Test::Run()+0xe3) [0x564e0cb85d43] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 18: ceph_test_client(+0x1d1165) [0x564e0cba5165] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 19: ceph_test_client(+0x1d12f9) [0x564e0cba52f9] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 20: (testing::internal::UnitTestImpl::RunAllTests()+0x804) [0x564e0cb97604] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 21: (testing::UnitTest::Run()+0x1a8) [0x564e0cb939a8] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 22: main() 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 23: /lib64/libc.so.6(+0x3feb0) [0x7f0366a3feb0] 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 24: __libc_start_main() 2024-04-01T15:23:44.973 INFO:tasks.workunit.client.0.smithi142.stderr: 25: _start() 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-04-01T15:23:44.974 INFO:tasks.workunit.client.0.smithi142.stderr: 3/ 5 mds_quiesce 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 client 2024-04-01T15:23:44.975 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 ms 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-04-01T15:23:44.976 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_notification 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-04-01T15:23:44.977 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-04-01T15:23:44.978 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-04-01T15:23:44.979 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0358a00640 / safe_timer 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0359400640 / ceph_test_clien 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 7f035a800640 / msgr-worker-2 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0360a00640 / ms_dispatch 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0361e00640 / ceph_timer 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0362800640 / io_context_pool 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0363200640 / msgr-worker-1 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 7f0363c00640 / msgr-worker-0 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: 7f036683d480 / ceph_test_clien 2024-04-01T15:23:44.980 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-04-01T15:23:44.981 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-04-01T15:23:44.981 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/lib/ceph/crash/2024-04-01T15:23:44.835949Z_51f9a2bd-b65c-49e6-a634-9cfe36a355b1/log 2024-04-01T15:23:44.981 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-04-01T15:23:44.981 DEBUG:teuthology.orchestra.run:got remote process result: 134 2024-04-01T15:23:44.982 INFO:tasks.workunit.client.0.smithi142.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh: line 5: 45288 Aborted (core dumped) ceph_test_client 2024-04-01T15:23:44.982 INFO:tasks.workunit:Stopping ['client/test.sh'] on client.0... 2024-04-01T15:23:44.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-01T15:23:45.932 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test client/test.sh) on smithi142 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2271579d5e735cfd6d436b8349c004f06527cb0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh' 2024-04-01T15:23:46.148 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=939d1f229cbf48c293ef631bfc73a5d7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test client/test.sh) on smithi142 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2271579d5e735cfd6d436b8349c004f06527cb0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh' 2024-04-01T15:23:46.150 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-01T15:23:46.161 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-01T15:23:46.161 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:23:46.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.380+0000 7f99d7c00640 1 Processor -- start 2024-04-01T15:23:46.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.380+0000 7f99d7c00640 1 -- start start 2024-04-01T15:23:46.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.381+0000 7f99d7c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f99d01510f0 0x7f99d01534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.381+0000 7f99d7c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d00ae330 con 0x7f99d00aded0 2024-04-01T15:23:46.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.382+0000 7f99d7c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d00b01a0 con 0x7f99d00adaf0 2024-04-01T15:23:46.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.382+0000 7f99d7c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f99d00b3780 con 0x7f99d01510f0 2024-04-01T15:23:46.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.382+0000 7f99cfe00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f99d00aded0 0x7f99d0147f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:32978/0 (socket says 172.21.15.142:32978) 2024-04-01T15:23:46.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.382+0000 7f99cfe00640 1 -- 172.21.15.142:0/935343030 learned_addr learned my addr 172.21.15.142:0/935343030 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:46.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.382+0000 7f99d5c00640 1 --2- 172.21.15.142:0/935343030 >> v2:172.21.15.179:3300/0 conn(0x7f99d01510f0 0x7f99d01534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:46.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.382+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668652485 0 0) 0x7f99d00ae330 con 0x7f99d00aded0 2024-04-01T15:23:46.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.382+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99b8003520 con 0x7f99d00aded0 2024-04-01T15:23:46.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.382+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 991431261 0 0) 0x7f99b8003520 con 0x7f99d00aded0 2024-04-01T15:23:46.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 >> v2:172.21.15.179:3300/0 conn(0x7f99d01510f0 msgr2=0x7f99d01534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:46.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 --2- 172.21.15.142:0/935343030 >> v2:172.21.15.179:3300/0 conn(0x7f99d01510f0 0x7f99d01534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 >> v1:172.21.15.179:6789/0 conn(0x7f99d00adaf0 legacy=0x7f99d00b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d00af110 con 0x7f99d00aded0 2024-04-01T15:23:46.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f99bc001670 con 0x7f99d00aded0 2024-04-01T15:23:46.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 >> v1:172.21.15.142:6789/0 conn(0x7f99d00aded0 legacy=0x7f99d0147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 --2- 172.21.15.142:0/935343030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 --2- 172.21.15.142:0/935343030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99b8004800 0x7f99b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 --2- 172.21.15.142:0/935343030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99b80051c0 0x7f99b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f99d00b3780 con 0x7f99b80039b0 2024-04-01T15:23:46.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99b800c160 con 0x7f99b80051c0 2024-04-01T15:23:46.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99b800c360 con 0x7f99b8004800 2024-04-01T15:23:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99d5200640 1 --2- 172.21.15.142:0/935343030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99d5200640 1 -- 172.21.15.142:0/935343030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99b8004800 msgr2=0x7f99b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99d5200640 1 --2- 172.21.15.142:0/935343030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99b8004800 0x7f99b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99d5200640 1 -- 172.21.15.142:0/935343030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99b80051c0 msgr2=0x7f99b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99d5200640 1 --2- 172.21.15.142:0/935343030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99b80051c0 0x7f99b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99d5c00640 1 -- 172.21.15.142:0/935343030 reap_dead start 2024-04-01T15:23:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.383+0000 7f99d5200640 1 -- 172.21.15.142:0/935343030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b8003520 con 0x7f99b80039b0 2024-04-01T15:23:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.384+0000 7f99d5200640 1 --2- 172.21.15.142:0/935343030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99b8003dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f99c4001750 tx=0x7f99b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c555f42e06cf7a34 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:46.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4001370 con 0x7f99b80039b0 2024-04-01T15:23:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c40052d0 con 0x7f99b80039b0 2024-04-01T15:23:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99cf400640 1 -- 172.21.15.142:0/935343030 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4003830 con 0x7f99b80039b0 2024-04-01T15:23:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99d7c00640 1 -- 172.21.15.142:0/935343030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 msgr2=0x7f99b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99d7c00640 1 --2- 172.21.15.142:0/935343030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99b8003dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f99c4001750 tx=0x7f99b8005830 comp rx=0 tx=0).stop 2024-04-01T15:23:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99d7c00640 1 -- 172.21.15.142:0/935343030 shutdown_connections 2024-04-01T15:23:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99d7c00640 1 --2- 172.21.15.142:0/935343030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99b8003dd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99d7c00640 1 -- 172.21.15.142:0/935343030 >> 172.21.15.142:0/935343030 conn(0x7f99d00b9210 msgr2=0x7f99d00b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99d7c00640 1 -- 172.21.15.142:0/935343030 shutdown_connections 2024-04-01T15:23:46.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.385+0000 7f99d7c00640 1 -- 172.21.15.142:0/935343030 wait complete. 2024-04-01T15:23:46.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.387+0000 7f99d7c00640 1 Processor -- start 2024-04-01T15:23:46.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.387+0000 7f99d7c00640 1 -- start start 2024-04-01T15:23:46.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99d7c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99d0143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99d7c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d0143d40 0x7f99d013a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99d7c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d013a670 0x7f99d01403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99d7c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f99d00aed30 con 0x7f99b80039b0 2024-04-01T15:23:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99d7c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99d00afde0 con 0x7f99d013a670 2024-04-01T15:23:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99d7c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99d00aeeb0 con 0x7f99d0143d40 2024-04-01T15:23:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99d5200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99d0143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:46.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99d5200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99d0143800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37754/0 (socket says 172.21.15.142:37754) 2024-04-01T15:23:46.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99d5200640 1 -- 172.21.15.142:0/3700456732 learned_addr learned my addr 172.21.15.142:0/3700456732 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:46.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.388+0000 7f99cfe00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d0143d40 0x7f99d013a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:46.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99d5c00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d013a670 0x7f99d01403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:46.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99d5200640 1 -- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d0143d40 msgr2=0x7f99d013a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99d5200640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d0143d40 0x7f99d013a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99d5200640 1 -- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d013a670 msgr2=0x7f99d01403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99d5200640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d013a670 0x7f99d01403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99d5200640 1 -- 172.21.15.142:0/3700456732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d0144f50 con 0x7f99b80039b0 2024-04-01T15:23:46.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99d5200640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99d0143800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99c4001870 tx=0x7f99c4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:46.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99ccc00640 1 -- 172.21.15.142:0/3700456732 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4041020 con 0x7f99b80039b0 2024-04-01T15:23:46.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99ccc00640 1 -- 172.21.15.142:0/3700456732 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c4005480 con 0x7f99b80039b0 2024-04-01T15:23:46.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99ccc00640 1 -- 172.21.15.142:0/3700456732 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4007a30 con 0x7f99b80039b0 2024-04-01T15:23:46.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d013aaf0 con 0x7f99b80039b0 2024-04-01T15:23:46.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.389+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d01e0d90 con 0x7f99b80039b0 2024-04-01T15:23:46.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.390+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d0068710 con 0x7f99b80039b0 2024-04-01T15:23:46.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.391+0000 7f99ccc00640 1 -- 172.21.15.142:0/3700456732 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99c4044020 con 0x7f99b80039b0 2024-04-01T15:23:46.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.392+0000 7f99ccc00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f99b006c920 0x7f99b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.392+0000 7f99ccc00640 1 -- 172.21.15.142:0/3700456732 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f99c40ad590 con 0x7f99b80039b0 2024-04-01T15:23:46.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.393+0000 7f99cfe00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f99b006c920 0x7f99b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:46.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.394+0000 7f99cfe00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f99b006c920 0x7f99b006ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99bc001860 tx=0x7f99bc001650 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:46.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.397+0000 7f99ccc00640 1 -- 172.21.15.142:0/3700456732 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f99c404b030 con 0x7f99b80039b0 2024-04-01T15:23:46.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.581+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f99d0145240 con 0x7f99b006c920 2024-04-01T15:23:46.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.602+0000 7f99ccc00640 1 -- 172.21.15.142:0/3700456732 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251828 (secure 0 0 0) 0x7f99d0145240 con 0x7f99b006c920 2024-04-01T15:23:46.606 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:23:46.608 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:23:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f99b006c920 msgr2=0x7f99b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f99b006c920 0x7f99b006ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99bc001860 tx=0x7f99bc001650 comp rx=0 tx=0).stop 2024-04-01T15:23:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 msgr2=0x7f99d0143800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99d0143800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99c4001870 tx=0x7f99c4001120 comp rx=0 tx=0).stop 2024-04-01T15:23:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 shutdown_connections 2024-04-01T15:23:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f99b006c920 0x7f99b006ede0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99d013a670 0x7f99d01403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99d0143d40 0x7f99d013a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 --2- 172.21.15.142:0/3700456732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b80039b0 0x7f99d0143800 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.608+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 >> 172.21.15.142:0/3700456732 conn(0x7f99d00b9210 msgr2=0x7f99d00b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.609+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 shutdown_connections 2024-04-01T15:23:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.609+0000 7f99d7c00640 1 -- 172.21.15.142:0/3700456732 wait complete. 2024-04-01T15:23:46.627 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-01T15:23:44.596995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3088384,"data_stored":1850548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004877"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747701+0000","last_change":"2024-04-01T15:21:58.539004+0000","last_active":"2024-04-01T15:22:39.747701+0000","last_peered":"2024-04-01T15:22:39.747701+0000","last_clean":"2024-04-01T15:22:39.747701+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:22:39.747701+0000","last_undegraded":"2024-04-01T15:22:39.747701+0000","last_fullsized":"2024-04-01T15:22:39.747701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737668+0000","last_change":"2024-04-01T15:21:58.524238+0000","last_active":"2024-04-01T15:22:39.737668+0000","last_peered":"2024-04-01T15:22:39.737668+0000","last_clean":"2024-04-01T15:22:39.737668+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:22:39.737668+0000","last_undegraded":"2024-04-01T15:22:39.737668+0000","last_fullsized":"2024-04-01T15:22:39.737668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748607+0000","last_change":"2024-04-01T15:21:58.526226+0000","last_active":"2024-04-01T15:22:39.748607+0000","last_peered":"2024-04-01T15:22:39.748607+0000","last_clean":"2024-04-01T15:22:39.748607+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:22:39.748607+0000","last_undegraded":"2024-04-01T15:22:39.748607+0000","last_fullsized":"2024-04-01T15:22:39.748607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732299+0000","last_change":"2024-04-01T15:21:58.541297+0000","last_active":"2024-04-01T15:22:39.732299+0000","last_peered":"2024-04-01T15:22:39.732299+0000","last_clean":"2024-04-01T15:22:39.732299+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:22:39.732299+0000","last_undegraded":"2024-04-01T15:22:39.732299+0000","last_fullsized":"2024-04-01T15:22:39.732299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747043+0000","last_change":"2024-04-01T15:21:58.518814+0000","last_active":"2024-04-01T15:22:39.747043+0000","last_peered":"2024-04-01T15:22:39.747043+0000","last_clean":"2024-04-01T15:22:39.747043+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:22:39.747043+0000","last_undegraded":"2024-04-01T15:22:39.747043+0000","last_fullsized":"2024-04-01T15:22:39.747043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.755776+0000","last_change":"2024-04-01T15:22:39.753380+0000","last_active":"2024-04-01T15:22:39.755776+0000","last_peered":"2024-04-01T15:22:39.755776+0000","last_clean":"2024-04-01T15:22:39.755776+0000","last_became_active":"2024-04-01T15:22:39.752359+0000","last_became_peered":"2024-04-01T15:22:39.752359+0000","last_unstale":"2024-04-01T15:22:39.755776+0000","last_undegraded":"2024-04-01T15:22:39.755776+0000","last_fullsized":"2024-04-01T15:22:39.755776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747048+0000","last_change":"2024-04-01T15:21:58.522961+0000","last_active":"2024-04-01T15:22:39.747048+0000","last_peered":"2024-04-01T15:22:39.747048+0000","last_clean":"2024-04-01T15:22:39.747048+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:22:39.747048+0000","last_undegraded":"2024-04-01T15:22:39.747048+0000","last_fullsized":"2024-04-01T15:22:39.747048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:51:33.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751116+0000","last_change":"2024-04-01T15:21:58.530231+0000","last_active":"2024-04-01T15:22:39.751116+0000","last_peered":"2024-04-01T15:22:39.751116+0000","last_clean":"2024-04-01T15:22:39.751116+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:22:39.751116+0000","last_undegraded":"2024-04-01T15:22:39.751116+0000","last_fullsized":"2024-04-01T15:22:39.751116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747834+0000","last_change":"2024-04-01T15:21:58.526959+0000","last_active":"2024-04-01T15:22:39.747834+0000","last_peered":"2024-04-01T15:22:39.747834+0000","last_clean":"2024-04-01T15:22:39.747834+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:22:39.747834+0000","last_undegraded":"2024-04-01T15:22:39.747834+0000","last_fullsized":"2024-04-01T15:22:39.747834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.733705+0000","last_change":"2024-04-01T15:21:58.529489+0000","last_active":"2024-04-01T15:22:39.733705+0000","last_peered":"2024-04-01T15:22:39.733705+0000","last_clean":"2024-04-01T15:22:39.733705+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:22:39.733705+0000","last_undegraded":"2024-04-01T15:22:39.733705+0000","last_fullsized":"2024-04-01T15:22:39.733705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734352+0000","last_change":"2024-04-01T15:21:58.527803+0000","last_active":"2024-04-01T15:22:39.734352+0000","last_peered":"2024-04-01T15:22:39.734352+0000","last_clean":"2024-04-01T15:22:39.734352+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:22:39.734352+0000","last_undegraded":"2024-04-01T15:22:39.734352+0000","last_fullsized":"2024-04-01T15:22:39.734352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748645+0000","last_change":"2024-04-01T15:21:58.535848+0000","last_active":"2024-04-01T15:22:39.748645+0000","last_peered":"2024-04-01T15:22:39.748645+0000","last_clean":"2024-04-01T15:22:39.748645+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:22:39.748645+0000","last_undegraded":"2024-04-01T15:22:39.748645+0000","last_fullsized":"2024-04-01T15:22:39.748645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752869+0000","last_change":"2024-04-01T15:21:58.528912+0000","last_active":"2024-04-01T15:22:39.752869+0000","last_peered":"2024-04-01T15:22:39.752869+0000","last_clean":"2024-04-01T15:22:39.752869+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:22:39.752869+0000","last_undegraded":"2024-04-01T15:22:39.752869+0000","last_fullsized":"2024-04-01T15:22:39.752869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748368+0000","last_change":"2024-04-01T15:21:58.529847+0000","last_active":"2024-04-01T15:22:39.748368+0000","last_peered":"2024-04-01T15:22:39.748368+0000","last_clean":"2024-04-01T15:22:39.748368+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:22:39.748368+0000","last_undegraded":"2024-04-01T15:22:39.748368+0000","last_fullsized":"2024-04-01T15:22:39.748368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:44:07.006946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737739+0000","last_change":"2024-04-01T15:21:58.535414+0000","last_active":"2024-04-01T15:22:39.737739+0000","last_peered":"2024-04-01T15:22:39.737739+0000","last_clean":"2024-04-01T15:22:39.737739+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:22:39.737739+0000","last_undegraded":"2024-04-01T15:22:39.737739+0000","last_fullsized":"2024-04-01T15:22:39.737739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.730860+0000","last_change":"2024-04-01T15:21:58.522234+0000","last_active":"2024-04-01T15:22:39.730860+0000","last_peered":"2024-04-01T15:22:39.730860+0000","last_clean":"2024-04-01T15:22:39.730860+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:22:39.730860+0000","last_undegraded":"2024-04-01T15:22:39.730860+0000","last_fullsized":"2024-04-01T15:22:39.730860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732253+0000","last_change":"2024-04-01T15:21:58.531397+0000","last_active":"2024-04-01T15:22:39.732253+0000","last_peered":"2024-04-01T15:22:39.732253+0000","last_clean":"2024-04-01T15:22:39.732253+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:22:39.732253+0000","last_undegraded":"2024-04-01T15:22:39.732253+0000","last_fullsized":"2024-04-01T15:22:39.732253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728872+0000","last_change":"2024-04-01T15:21:58.522828+0000","last_active":"2024-04-01T15:22:39.728872+0000","last_peered":"2024-04-01T15:22:39.728872+0000","last_clean":"2024-04-01T15:22:39.728872+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:22:39.728872+0000","last_undegraded":"2024-04-01T15:22:39.728872+0000","last_fullsized":"2024-04-01T15:22:39.728872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747574+0000","last_change":"2024-04-01T15:21:58.532575+0000","last_active":"2024-04-01T15:22:39.747574+0000","last_peered":"2024-04-01T15:22:39.747574+0000","last_clean":"2024-04-01T15:22:39.747574+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:22:39.747574+0000","last_undegraded":"2024-04-01T15:22:39.747574+0000","last_fullsized":"2024-04-01T15:22:39.747574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731248+0000","last_change":"2024-04-01T15:21:58.530543+0000","last_active":"2024-04-01T15:22:39.731248+0000","last_peered":"2024-04-01T15:22:39.731248+0000","last_clean":"2024-04-01T15:22:39.731248+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:22:39.731248+0000","last_undegraded":"2024-04-01T15:22:39.731248+0000","last_fullsized":"2024-04-01T15:22:39.731248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748156+0000","last_change":"2024-04-01T15:21:58.528377+0000","last_active":"2024-04-01T15:22:39.748156+0000","last_peered":"2024-04-01T15:22:39.748156+0000","last_clean":"2024-04-01T15:22:39.748156+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:22:39.748156+0000","last_undegraded":"2024-04-01T15:22:39.748156+0000","last_fullsized":"2024-04-01T15:22:39.748156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:56:09.008728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731285+0000","last_change":"2024-04-01T15:21:58.530746+0000","last_active":"2024-04-01T15:22:39.731285+0000","last_peered":"2024-04-01T15:22:39.731285+0000","last_clean":"2024-04-01T15:22:39.731285+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:22:39.731285+0000","last_undegraded":"2024-04-01T15:22:39.731285+0000","last_fullsized":"2024-04-01T15:22:39.731285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749986+0000","last_change":"2024-04-01T15:21:58.516408+0000","last_active":"2024-04-01T15:22:39.749986+0000","last_peered":"2024-04-01T15:22:39.749986+0000","last_clean":"2024-04-01T15:22:39.749986+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:22:39.749986+0000","last_undegraded":"2024-04-01T15:22:39.749986+0000","last_fullsized":"2024-04-01T15:22:39.749986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731046+0000","last_change":"2024-04-01T15:21:58.525868+0000","last_active":"2024-04-01T15:22:39.731046+0000","last_peered":"2024-04-01T15:22:39.731046+0000","last_clean":"2024-04-01T15:22:39.731046+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:22:39.731046+0000","last_undegraded":"2024-04-01T15:22:39.731046+0000","last_fullsized":"2024-04-01T15:22:39.731046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754513+0000","last_change":"2024-04-01T15:21:58.531952+0000","last_active":"2024-04-01T15:22:39.754513+0000","last_peered":"2024-04-01T15:22:39.754513+0000","last_clean":"2024-04-01T15:22:39.754513+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:22:39.754513+0000","last_undegraded":"2024-04-01T15:22:39.754513+0000","last_fullsized":"2024-04-01T15:22:39.754513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.733953+0000","last_change":"2024-04-01T15:21:58.517341+0000","last_active":"2024-04-01T15:22:39.733953+0000","last_peered":"2024-04-01T15:22:39.733953+0000","last_clean":"2024-04-01T15:22:39.733953+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:22:39.733953+0000","last_undegraded":"2024-04-01T15:22:39.733953+0000","last_fullsized":"2024-04-01T15:22:39.733953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737920+0000","last_change":"2024-04-01T15:21:58.535087+0000","last_active":"2024-04-01T15:22:39.737920+0000","last_peered":"2024-04-01T15:22:39.737920+0000","last_clean":"2024-04-01T15:22:39.737920+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:22:39.737920+0000","last_undegraded":"2024-04-01T15:22:39.737920+0000","last_fullsized":"2024-04-01T15:22:39.737920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752727+0000","last_change":"2024-04-01T15:21:58.531487+0000","last_active":"2024-04-01T15:22:39.752727+0000","last_peered":"2024-04-01T15:22:39.752727+0000","last_clean":"2024-04-01T15:22:39.752727+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:22:39.752727+0000","last_undegraded":"2024-04-01T15:22:39.752727+0000","last_fullsized":"2024-04-01T15:22:39.752727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748164+0000","last_change":"2024-04-01T15:21:58.531305+0000","last_active":"2024-04-01T15:22:39.748164+0000","last_peered":"2024-04-01T15:22:39.748164+0000","last_clean":"2024-04-01T15:22:39.748164+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:22:39.748164+0000","last_undegraded":"2024-04-01T15:22:39.748164+0000","last_fullsized":"2024-04-01T15:22:39.748164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731539+0000","last_change":"2024-04-01T15:21:58.530998+0000","last_active":"2024-04-01T15:22:39.731539+0000","last_peered":"2024-04-01T15:22:39.731539+0000","last_clean":"2024-04-01T15:22:39.731539+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:22:39.731539+0000","last_undegraded":"2024-04-01T15:22:39.731539+0000","last_fullsized":"2024-04-01T15:22:39.731539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728576+0000","last_change":"2024-04-01T15:21:58.523119+0000","last_active":"2024-04-01T15:22:39.728576+0000","last_peered":"2024-04-01T15:22:39.728576+0000","last_clean":"2024-04-01T15:22:39.728576+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:22:39.728576+0000","last_undegraded":"2024-04-01T15:22:39.728576+0000","last_fullsized":"2024-04-01T15:22:39.728576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.730767+0000","last_change":"2024-04-01T15:21:58.514302+0000","last_active":"2024-04-01T15:22:39.730767+0000","last_peered":"2024-04-01T15:22:39.730767+0000","last_clean":"2024-04-01T15:22:39.730767+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:22:39.730767+0000","last_undegraded":"2024-04-01T15:22:39.730767+0000","last_fullsized":"2024-04-01T15:22:39.730767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748155+0000","last_change":"2024-04-01T15:21:58.528525+0000","last_active":"2024-04-01T15:22:39.748155+0000","last_peered":"2024-04-01T15:22:39.748155+0000","last_clean":"2024-04-01T15:22:39.748155+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:22:39.748155+0000","last_undegraded":"2024-04-01T15:22:39.748155+0000","last_fullsized":"2024-04-01T15:22:39.748155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:58.054203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.753403+0000","last_change":"2024-04-01T15:21:57.523557+0000","last_active":"2024-04-01T15:22:39.753403+0000","last_peered":"2024-04-01T15:22:39.753403+0000","last_clean":"2024-04-01T15:22:39.753403+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:22:39.753403+0000","last_undegraded":"2024-04-01T15:22:39.753403+0000","last_fullsized":"2024-04-01T15:22:39.753403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748537+0000","last_change":"2024-04-01T15:21:58.531570+0000","last_active":"2024-04-01T15:22:39.748537+0000","last_peered":"2024-04-01T15:22:39.748537+0000","last_clean":"2024-04-01T15:22:39.748537+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:22:39.748537+0000","last_undegraded":"2024-04-01T15:22:39.748537+0000","last_fullsized":"2024-04-01T15:22:39.748537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732276+0000","last_change":"2024-04-01T15:21:57.519248+0000","last_active":"2024-04-01T15:22:39.732276+0000","last_peered":"2024-04-01T15:22:39.732276+0000","last_clean":"2024-04-01T15:22:39.732276+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:22:39.732276+0000","last_undegraded":"2024-04-01T15:22:39.732276+0000","last_fullsized":"2024-04-01T15:22:39.732276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751667+0000","last_change":"2024-04-01T15:21:57.518727+0000","last_active":"2024-04-01T15:22:39.751667+0000","last_peered":"2024-04-01T15:22:39.751667+0000","last_clean":"2024-04-01T15:22:39.751667+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:22:39.751667+0000","last_undegraded":"2024-04-01T15:22:39.751667+0000","last_fullsized":"2024-04-01T15:22:39.751667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:15:36.993209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752004+0000","last_change":"2024-04-01T15:21:58.527894+0000","last_active":"2024-04-01T15:22:39.752004+0000","last_peered":"2024-04-01T15:22:39.752004+0000","last_clean":"2024-04-01T15:22:39.752004+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:22:39.752004+0000","last_undegraded":"2024-04-01T15:22:39.752004+0000","last_fullsized":"2024-04-01T15:22:39.752004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731247+0000","last_change":"2024-04-01T15:21:57.534982+0000","last_active":"2024-04-01T15:22:39.731247+0000","last_peered":"2024-04-01T15:22:39.731247+0000","last_clean":"2024-04-01T15:22:39.731247+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:22:39.731247+0000","last_undegraded":"2024-04-01T15:22:39.731247+0000","last_fullsized":"2024-04-01T15:22:39.731247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737161+0000","last_change":"2024-04-01T15:21:58.525017+0000","last_active":"2024-04-01T15:22:39.737161+0000","last_peered":"2024-04-01T15:22:39.737161+0000","last_clean":"2024-04-01T15:22:39.737161+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:22:39.737161+0000","last_undegraded":"2024-04-01T15:22:39.737161+0000","last_fullsized":"2024-04-01T15:22:39.737161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734537+0000","last_change":"2024-04-01T15:21:57.528840+0000","last_active":"2024-04-01T15:22:39.734537+0000","last_peered":"2024-04-01T15:22:39.734537+0000","last_clean":"2024-04-01T15:22:39.734537+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:22:39.734537+0000","last_undegraded":"2024-04-01T15:22:39.734537+0000","last_fullsized":"2024-04-01T15:22:39.734537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732656+0000","last_change":"2024-04-01T15:21:58.529422+0000","last_active":"2024-04-01T15:22:39.732656+0000","last_peered":"2024-04-01T15:22:39.732656+0000","last_clean":"2024-04-01T15:22:39.732656+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:22:39.732656+0000","last_undegraded":"2024-04-01T15:22:39.732656+0000","last_fullsized":"2024-04-01T15:22:39.732656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732852+0000","last_change":"2024-04-01T15:21:57.528345+0000","last_active":"2024-04-01T15:22:39.732852+0000","last_peered":"2024-04-01T15:22:39.732852+0000","last_clean":"2024-04-01T15:22:39.732852+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:22:39.732852+0000","last_undegraded":"2024-04-01T15:22:39.732852+0000","last_fullsized":"2024-04-01T15:22:39.732852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749777+0000","last_change":"2024-04-01T15:21:58.529376+0000","last_active":"2024-04-01T15:22:39.749777+0000","last_peered":"2024-04-01T15:22:39.749777+0000","last_clean":"2024-04-01T15:22:39.749777+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:22:39.749777+0000","last_undegraded":"2024-04-01T15:22:39.749777+0000","last_fullsized":"2024-04-01T15:22:39.749777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738000+0000","last_change":"2024-04-01T15:21:57.526610+0000","last_active":"2024-04-01T15:22:39.738000+0000","last_peered":"2024-04-01T15:22:39.738000+0000","last_clean":"2024-04-01T15:22:39.738000+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:22:39.738000+0000","last_undegraded":"2024-04-01T15:22:39.738000+0000","last_fullsized":"2024-04-01T15:22:39.738000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748837+0000","last_change":"2024-04-01T15:21:58.537476+0000","last_active":"2024-04-01T15:22:39.748837+0000","last_peered":"2024-04-01T15:22:39.748837+0000","last_clean":"2024-04-01T15:22:39.748837+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:22:39.748837+0000","last_undegraded":"2024-04-01T15:22:39.748837+0000","last_fullsized":"2024-04-01T15:22:39.748837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731532+0000","last_change":"2024-04-01T15:21:57.513766+0000","last_active":"2024-04-01T15:22:39.731532+0000","last_peered":"2024-04-01T15:22:39.731532+0000","last_clean":"2024-04-01T15:22:39.731532+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:22:39.731532+0000","last_undegraded":"2024-04-01T15:22:39.731532+0000","last_fullsized":"2024-04-01T15:22:39.731532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747415+0000","last_change":"2024-04-01T15:21:58.539751+0000","last_active":"2024-04-01T15:22:39.747415+0000","last_peered":"2024-04-01T15:22:39.747415+0000","last_clean":"2024-04-01T15:22:39.747415+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:22:39.747415+0000","last_undegraded":"2024-04-01T15:22:39.747415+0000","last_fullsized":"2024-04-01T15:22:39.747415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748814+0000","last_change":"2024-04-01T15:21:57.520158+0000","last_active":"2024-04-01T15:22:39.748814+0000","last_peered":"2024-04-01T15:22:39.748814+0000","last_clean":"2024-04-01T15:22:39.748814+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:22:39.748814+0000","last_undegraded":"2024-04-01T15:22:39.748814+0000","last_fullsized":"2024-04-01T15:22:39.748814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748643+0000","last_change":"2024-04-01T15:21:58.532249+0000","last_active":"2024-04-01T15:22:39.748643+0000","last_peered":"2024-04-01T15:22:39.748643+0000","last_clean":"2024-04-01T15:22:39.748643+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:22:39.748643+0000","last_undegraded":"2024-04-01T15:22:39.748643+0000","last_fullsized":"2024-04-01T15:22:39.748643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.229948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731604+0000","last_change":"2024-04-01T15:21:57.528780+0000","last_active":"2024-04-01T15:22:39.731604+0000","last_peered":"2024-04-01T15:22:39.731604+0000","last_clean":"2024-04-01T15:22:39.731604+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:22:39.731604+0000","last_undegraded":"2024-04-01T15:22:39.731604+0000","last_fullsized":"2024-04-01T15:22:39.731604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747190+0000","last_change":"2024-04-01T15:21:58.528458+0000","last_active":"2024-04-01T15:22:39.747190+0000","last_peered":"2024-04-01T15:22:39.747190+0000","last_clean":"2024-04-01T15:22:39.747190+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:22:39.747190+0000","last_undegraded":"2024-04-01T15:22:39.747190+0000","last_fullsized":"2024-04-01T15:22:39.747190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731732+0000","last_change":"2024-04-01T15:21:57.528026+0000","last_active":"2024-04-01T15:22:39.731732+0000","last_peered":"2024-04-01T15:22:39.731732+0000","last_clean":"2024-04-01T15:22:39.731732+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:22:39.731732+0000","last_undegraded":"2024-04-01T15:22:39.731732+0000","last_fullsized":"2024-04-01T15:22:39.731732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731062+0000","last_change":"2024-04-01T15:21:58.514047+0000","last_active":"2024-04-01T15:22:39.731062+0000","last_peered":"2024-04-01T15:22:39.731062+0000","last_clean":"2024-04-01T15:22:39.731062+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:22:39.731062+0000","last_undegraded":"2024-04-01T15:22:39.731062+0000","last_fullsized":"2024-04-01T15:22:39.731062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728412+0000","last_change":"2024-04-01T15:21:57.517184+0000","last_active":"2024-04-01T15:22:39.728412+0000","last_peered":"2024-04-01T15:22:39.728412+0000","last_clean":"2024-04-01T15:22:39.728412+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:22:39.728412+0000","last_undegraded":"2024-04-01T15:22:39.728412+0000","last_fullsized":"2024-04-01T15:22:39.728412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746976+0000","last_change":"2024-04-01T15:21:58.529946+0000","last_active":"2024-04-01T15:22:39.746976+0000","last_peered":"2024-04-01T15:22:39.746976+0000","last_clean":"2024-04-01T15:22:39.746976+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:22:39.746976+0000","last_undegraded":"2024-04-01T15:22:39.746976+0000","last_fullsized":"2024-04-01T15:22:39.746976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748524+0000","last_change":"2024-04-01T15:21:57.519642+0000","last_active":"2024-04-01T15:22:39.748524+0000","last_peered":"2024-04-01T15:22:39.748524+0000","last_clean":"2024-04-01T15:22:39.748524+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:22:39.748524+0000","last_undegraded":"2024-04-01T15:22:39.748524+0000","last_fullsized":"2024-04-01T15:22:39.748524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:09:07.894019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747731+0000","last_change":"2024-04-01T15:21:58.529121+0000","last_active":"2024-04-01T15:22:39.747731+0000","last_peered":"2024-04-01T15:22:39.747731+0000","last_clean":"2024-04-01T15:22:39.747731+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:22:39.747731+0000","last_undegraded":"2024-04-01T15:22:39.747731+0000","last_fullsized":"2024-04-01T15:22:39.747731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.729158+0000","last_change":"2024-04-01T15:21:57.514455+0000","last_active":"2024-04-01T15:22:39.729158+0000","last_peered":"2024-04-01T15:22:39.729158+0000","last_clean":"2024-04-01T15:22:39.729158+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:22:39.729158+0000","last_undegraded":"2024-04-01T15:22:39.729158+0000","last_fullsized":"2024-04-01T15:22:39.729158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747837+0000","last_change":"2024-04-01T15:21:58.535610+0000","last_active":"2024-04-01T15:22:39.747837+0000","last_peered":"2024-04-01T15:22:39.747837+0000","last_clean":"2024-04-01T15:22:39.747837+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:22:39.747837+0000","last_undegraded":"2024-04-01T15:22:39.747837+0000","last_fullsized":"2024-04-01T15:22:39.747837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738118+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:22:39.738118+0000","last_peered":"2024-04-01T15:22:39.738118+0000","last_clean":"2024-04-01T15:22:39.738118+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:22:39.738118+0000","last_undegraded":"2024-04-01T15:22:39.738118+0000","last_fullsized":"2024-04-01T15:22:39.738118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.740524+0000","last_change":"2024-04-01T15:22:39.740524+0000","last_active":"2024-04-01T15:22:39.740524+0000","last_peered":"2024-04-01T15:22:39.740524+0000","last_clean":"2024-04-01T15:22:39.740524+0000","last_became_active":"2024-04-01T15:22:39.739729+0000","last_became_peered":"2024-04-01T15:22:39.739729+0000","last_unstale":"2024-04-01T15:22:39.740524+0000","last_undegraded":"2024-04-01T15:22:39.740524+0000","last_fullsized":"2024-04-01T15:22:39.740524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:42.451490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.729348+0000","last_change":"2024-04-01T15:21:57.532167+0000","last_active":"2024-04-01T15:22:39.729348+0000","last_peered":"2024-04-01T15:22:39.729348+0000","last_clean":"2024-04-01T15:22:39.729348+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:22:39.729348+0000","last_undegraded":"2024-04-01T15:22:39.729348+0000","last_fullsized":"2024-04-01T15:22:39.729348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.745212+0000","last_change":"2024-04-01T15:22:39.741396+0000","last_active":"2024-04-01T15:22:39.745212+0000","last_peered":"2024-04-01T15:22:39.745212+0000","last_clean":"2024-04-01T15:22:39.745212+0000","last_became_active":"2024-04-01T15:22:39.740443+0000","last_became_peered":"2024-04-01T15:22:39.740443+0000","last_unstale":"2024-04-01T15:22:39.745212+0000","last_undegraded":"2024-04-01T15:22:39.745212+0000","last_fullsized":"2024-04-01T15:22:39.745212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:25:59.110797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746901+0000","last_change":"2024-04-01T15:21:47.878530+0000","last_active":"2024-04-01T15:22:39.746901+0000","last_peered":"2024-04-01T15:22:39.746901+0000","last_clean":"2024-04-01T15:22:39.746901+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:22:39.746901+0000","last_undegraded":"2024-04-01T15:22:39.746901+0000","last_fullsized":"2024-04-01T15:22:39.746901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_clean_scrub_stamp":"2024-04-01T15:21:46.852307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:25:18.137507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731374+0000","last_change":"2024-04-01T15:21:57.530394+0000","last_active":"2024-04-01T15:22:39.731374+0000","last_peered":"2024-04-01T15:22:39.731374+0000","last_clean":"2024-04-01T15:22:39.731374+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:22:39.731374+0000","last_undegraded":"2024-04-01T15:22:39.731374+0000","last_fullsized":"2024-04-01T15:22:39.731374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752344+0000","last_change":"2024-04-01T15:21:58.529751+0000","last_active":"2024-04-01T15:22:39.752344+0000","last_peered":"2024-04-01T15:22:39.752344+0000","last_clean":"2024-04-01T15:22:39.752344+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:22:39.752344+0000","last_undegraded":"2024-04-01T15:22:39.752344+0000","last_fullsized":"2024-04-01T15:22:39.752344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746918+0000","last_change":"2024-04-01T15:21:57.526919+0000","last_active":"2024-04-01T15:22:39.746918+0000","last_peered":"2024-04-01T15:22:39.746918+0000","last_clean":"2024-04-01T15:22:39.746918+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:22:39.746918+0000","last_undegraded":"2024-04-01T15:22:39.746918+0000","last_fullsized":"2024-04-01T15:22:39.746918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747676+0000","last_change":"2024-04-01T15:21:58.525329+0000","last_active":"2024-04-01T15:22:39.747676+0000","last_peered":"2024-04-01T15:22:39.747676+0000","last_clean":"2024-04-01T15:22:39.747676+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:22:39.747676+0000","last_undegraded":"2024-04-01T15:22:39.747676+0000","last_fullsized":"2024-04-01T15:22:39.747676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728881+0000","last_change":"2024-04-01T15:21:57.511176+0000","last_active":"2024-04-01T15:22:39.728881+0000","last_peered":"2024-04-01T15:22:39.728881+0000","last_clean":"2024-04-01T15:22:39.728881+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:22:39.728881+0000","last_undegraded":"2024-04-01T15:22:39.728881+0000","last_fullsized":"2024-04-01T15:22:39.728881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737037+0000","last_change":"2024-04-01T15:21:58.523794+0000","last_active":"2024-04-01T15:22:39.737037+0000","last_peered":"2024-04-01T15:22:39.737037+0000","last_clean":"2024-04-01T15:22:39.737037+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:22:39.737037+0000","last_undegraded":"2024-04-01T15:22:39.737037+0000","last_fullsized":"2024-04-01T15:22:39.737037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731803+0000","last_change":"2024-04-01T15:21:57.527763+0000","last_active":"2024-04-01T15:22:39.731803+0000","last_peered":"2024-04-01T15:22:39.731803+0000","last_clean":"2024-04-01T15:22:39.731803+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:22:39.731803+0000","last_undegraded":"2024-04-01T15:22:39.731803+0000","last_fullsized":"2024-04-01T15:22:39.731803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748426+0000","last_change":"2024-04-01T15:21:58.531026+0000","last_active":"2024-04-01T15:22:39.748426+0000","last_peered":"2024-04-01T15:22:39.748426+0000","last_clean":"2024-04-01T15:22:39.748426+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:22:39.748426+0000","last_undegraded":"2024-04-01T15:22:39.748426+0000","last_fullsized":"2024-04-01T15:22:39.748426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:50.706762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737539+0000","last_change":"2024-04-01T15:21:57.517159+0000","last_active":"2024-04-01T15:22:39.737539+0000","last_peered":"2024-04-01T15:22:39.737539+0000","last_clean":"2024-04-01T15:22:39.737539+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:22:39.737539+0000","last_undegraded":"2024-04-01T15:22:39.737539+0000","last_fullsized":"2024-04-01T15:22:39.737539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732520+0000","last_change":"2024-04-01T15:21:58.541348+0000","last_active":"2024-04-01T15:22:39.732520+0000","last_peered":"2024-04-01T15:22:39.732520+0000","last_clean":"2024-04-01T15:22:39.732520+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:22:39.732520+0000","last_undegraded":"2024-04-01T15:22:39.732520+0000","last_fullsized":"2024-04-01T15:22:39.732520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747695+0000","last_change":"2024-04-01T15:21:57.526914+0000","last_active":"2024-04-01T15:22:39.747695+0000","last_peered":"2024-04-01T15:22:39.747695+0000","last_clean":"2024-04-01T15:22:39.747695+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:22:39.747695+0000","last_undegraded":"2024-04-01T15:22:39.747695+0000","last_fullsized":"2024-04-01T15:22:39.747695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737407+0000","last_change":"2024-04-01T15:21:58.515834+0000","last_active":"2024-04-01T15:22:39.737407+0000","last_peered":"2024-04-01T15:22:39.737407+0000","last_clean":"2024-04-01T15:22:39.737407+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:22:39.737407+0000","last_undegraded":"2024-04-01T15:22:39.737407+0000","last_fullsized":"2024-04-01T15:22:39.737407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738464+0000","last_change":"2024-04-01T15:21:57.533452+0000","last_active":"2024-04-01T15:22:39.738464+0000","last_peered":"2024-04-01T15:22:39.738464+0000","last_clean":"2024-04-01T15:22:39.738464+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:22:39.738464+0000","last_undegraded":"2024-04-01T15:22:39.738464+0000","last_fullsized":"2024-04-01T15:22:39.738464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754786+0000","last_change":"2024-04-01T15:21:58.512191+0000","last_active":"2024-04-01T15:22:39.754786+0000","last_peered":"2024-04-01T15:22:39.754786+0000","last_clean":"2024-04-01T15:22:39.754786+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:22:39.754786+0000","last_undegraded":"2024-04-01T15:22:39.754786+0000","last_fullsized":"2024-04-01T15:22:39.754786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734713+0000","last_change":"2024-04-01T15:21:57.526196+0000","last_active":"2024-04-01T15:22:39.734713+0000","last_peered":"2024-04-01T15:22:39.734713+0000","last_clean":"2024-04-01T15:22:39.734713+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:22:39.734713+0000","last_undegraded":"2024-04-01T15:22:39.734713+0000","last_fullsized":"2024-04-01T15:22:39.734713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749441+0000","last_change":"2024-04-01T15:21:58.526739+0000","last_active":"2024-04-01T15:22:39.749441+0000","last_peered":"2024-04-01T15:22:39.749441+0000","last_clean":"2024-04-01T15:22:39.749441+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:22:39.749441+0000","last_undegraded":"2024-04-01T15:22:39.749441+0000","last_fullsized":"2024-04-01T15:22:39.749441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746750+0000","last_change":"2024-04-01T15:21:57.526924+0000","last_active":"2024-04-01T15:22:39.746750+0000","last_peered":"2024-04-01T15:22:39.746750+0000","last_clean":"2024-04-01T15:22:39.746750+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:22:39.746750+0000","last_undegraded":"2024-04-01T15:22:39.746750+0000","last_fullsized":"2024-04-01T15:22:39.746750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749243+0000","last_change":"2024-04-01T15:21:58.528396+0000","last_active":"2024-04-01T15:22:39.749243+0000","last_peered":"2024-04-01T15:22:39.749243+0000","last_clean":"2024-04-01T15:22:39.749243+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:22:39.749243+0000","last_undegraded":"2024-04-01T15:22:39.749243+0000","last_fullsized":"2024-04-01T15:22:39.749243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:50.943225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737525+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:22:39.737525+0000","last_peered":"2024-04-01T15:22:39.737525+0000","last_clean":"2024-04-01T15:22:39.737525+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:22:39.737525+0000","last_undegraded":"2024-04-01T15:22:39.737525+0000","last_fullsized":"2024-04-01T15:22:39.737525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:09.572891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751390+0000","last_change":"2024-04-01T15:21:58.529955+0000","last_active":"2024-04-01T15:22:39.751390+0000","last_peered":"2024-04-01T15:22:39.751390+0000","last_clean":"2024-04-01T15:22:39.751390+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:22:39.751390+0000","last_undegraded":"2024-04-01T15:22:39.751390+0000","last_fullsized":"2024-04-01T15:22:39.751390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737822+0000","last_change":"2024-04-01T15:21:57.526620+0000","last_active":"2024-04-01T15:22:39.737822+0000","last_peered":"2024-04-01T15:22:39.737822+0000","last_clean":"2024-04-01T15:22:39.737822+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:22:39.737822+0000","last_undegraded":"2024-04-01T15:22:39.737822+0000","last_fullsized":"2024-04-01T15:22:39.737822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.753152+0000","last_change":"2024-04-01T15:21:58.534484+0000","last_active":"2024-04-01T15:22:39.753152+0000","last_peered":"2024-04-01T15:22:39.753152+0000","last_clean":"2024-04-01T15:22:39.753152+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:22:39.753152+0000","last_undegraded":"2024-04-01T15:22:39.753152+0000","last_fullsized":"2024-04-01T15:22:39.753152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747363+0000","last_change":"2024-04-01T15:21:57.531639+0000","last_active":"2024-04-01T15:22:39.747363+0000","last_peered":"2024-04-01T15:22:39.747363+0000","last_clean":"2024-04-01T15:22:39.747363+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:22:39.747363+0000","last_undegraded":"2024-04-01T15:22:39.747363+0000","last_fullsized":"2024-04-01T15:22:39.747363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732012+0000","last_change":"2024-04-01T15:21:58.523366+0000","last_active":"2024-04-01T15:22:39.732012+0000","last_peered":"2024-04-01T15:22:39.732012+0000","last_clean":"2024-04-01T15:22:39.732012+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:22:39.732012+0000","last_undegraded":"2024-04-01T15:22:39.732012+0000","last_fullsized":"2024-04-01T15:22:39.732012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732440+0000","last_change":"2024-04-01T15:21:58.526457+0000","last_active":"2024-04-01T15:22:39.732440+0000","last_peered":"2024-04-01T15:22:39.732440+0000","last_clean":"2024-04-01T15:22:39.732440+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:22:39.732440+0000","last_undegraded":"2024-04-01T15:22:39.732440+0000","last_fullsized":"2024-04-01T15:22:39.732440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747278+0000","last_change":"2024-04-01T15:21:57.534510+0000","last_active":"2024-04-01T15:22:39.747278+0000","last_peered":"2024-04-01T15:22:39.747278+0000","last_clean":"2024-04-01T15:22:39.747278+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:22:39.747278+0000","last_undegraded":"2024-04-01T15:22:39.747278+0000","last_fullsized":"2024-04-01T15:22:39.747278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754630+0000","last_change":"2024-04-01T15:22:39.750841+0000","last_active":"2024-04-01T15:22:39.754630+0000","last_peered":"2024-04-01T15:22:39.754630+0000","last_clean":"2024-04-01T15:22:39.754630+0000","last_became_active":"2024-04-01T15:22:39.750255+0000","last_became_peered":"2024-04-01T15:22:39.750255+0000","last_unstale":"2024-04-01T15:22:39.754630+0000","last_undegraded":"2024-04-01T15:22:39.754630+0000","last_fullsized":"2024-04-01T15:22:39.754630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747532+0000","last_change":"2024-04-01T15:21:57.533797+0000","last_active":"2024-04-01T15:22:39.747532+0000","last_peered":"2024-04-01T15:22:39.747532+0000","last_clean":"2024-04-01T15:22:39.747532+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:22:39.747532+0000","last_undegraded":"2024-04-01T15:22:39.747532+0000","last_fullsized":"2024-04-01T15:22:39.747532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:16:16.205030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749155+0000","last_change":"2024-04-01T15:21:58.524922+0000","last_active":"2024-04-01T15:22:39.749155+0000","last_peered":"2024-04-01T15:22:39.749155+0000","last_clean":"2024-04-01T15:22:39.749155+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:22:39.749155+0000","last_undegraded":"2024-04-01T15:22:39.749155+0000","last_fullsized":"2024-04-01T15:22:39.749155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754618+0000","last_change":"2024-04-01T15:21:57.518934+0000","last_active":"2024-04-01T15:22:39.754618+0000","last_peered":"2024-04-01T15:22:39.754618+0000","last_clean":"2024-04-01T15:22:39.754618+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:22:39.754618+0000","last_undegraded":"2024-04-01T15:22:39.754618+0000","last_fullsized":"2024-04-01T15:22:39.754618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754328+0000","last_change":"2024-04-01T15:21:58.538259+0000","last_active":"2024-04-01T15:22:39.754328+0000","last_peered":"2024-04-01T15:22:39.754328+0000","last_clean":"2024-04-01T15:22:39.754328+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:22:39.754328+0000","last_undegraded":"2024-04-01T15:22:39.754328+0000","last_fullsized":"2024-04-01T15:22:39.754328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749835+0000","last_change":"2024-04-01T15:21:57.524507+0000","last_active":"2024-04-01T15:22:39.749835+0000","last_peered":"2024-04-01T15:22:39.749835+0000","last_clean":"2024-04-01T15:22:39.749835+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:22:39.749835+0000","last_undegraded":"2024-04-01T15:22:39.749835+0000","last_fullsized":"2024-04-01T15:22:39.749835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:29:44.659776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":674074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":84736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":83214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":83250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":84736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":83124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":83284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":674130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:23:46.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:23:46.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.880+0000 7fad2d800640 1 Processor -- start 2024-04-01T15:23:46.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.880+0000 7fad2d800640 1 -- start start 2024-04-01T15:23:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.881+0000 7fad2d800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad280aefa0 0x7fad280b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.881+0000 7fad2d800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad280b0290 0x7fad280b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.881+0000 7fad2d800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2806dcb0 con 0x7fad2806d8d0 2024-04-01T15:23:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.881+0000 7fad2d800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fad280b1790 con 0x7fad280b0290 2024-04-01T15:23:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.881+0000 7fad2d800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fad280b14b0 con 0x7fad280aefa0 2024-04-01T15:23:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.882+0000 7fad27400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad280b0290 0x7fad280b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.882+0000 7fad27400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad280b0290 0x7fad280b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37760/0 (socket says 172.21.15.142:37760) 2024-04-01T15:23:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.882+0000 7fad27400640 1 -- 172.21.15.142:0/3381303887 learned_addr learned my addr 172.21.15.142:0/3381303887 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:46.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.882+0000 7fad27400640 1 -- 172.21.15.142:0/3381303887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad280aefa0 msgr2=0x7fad280b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.882+0000 7fad27400640 1 --2- 172.21.15.142:0/3381303887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad280aefa0 0x7fad280b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.882+0000 7fad27400640 1 -- 172.21.15.142:0/3381303887 >> v1:172.21.15.179:6789/0 conn(0x7fad2806d8d0 legacy=0x7fad280ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.882+0000 7fad27400640 1 -- 172.21.15.142:0/3381303887 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad280b53b0 con 0x7fad280b0290 2024-04-01T15:23:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.883+0000 7fad27400640 1 --2- 172.21.15.142:0/3381303887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280b0290 0x7fad280b2160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad2002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440d139adcd1068f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.883+0000 7fad26000640 1 -- 172.21.15.142:0/3381303887 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2002cb00 con 0x7fad280b0290 2024-04-01T15:23:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad26000640 1 -- 172.21.15.142:0/3381303887 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2002cca0 con 0x7fad280b0290 2024-04-01T15:23:46.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad26000640 1 -- 172.21.15.142:0/3381303887 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20034610 con 0x7fad280b0290 2024-04-01T15:23:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad2d800640 1 -- 172.21.15.142:0/3381303887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280b0290 msgr2=0x7fad280b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad2d800640 1 --2- 172.21.15.142:0/3381303887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280b0290 0x7fad280b2160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad2002bf60 comp rx=0 tx=0).stop 2024-04-01T15:23:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad2d800640 1 -- 172.21.15.142:0/3381303887 shutdown_connections 2024-04-01T15:23:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad2d800640 1 --2- 172.21.15.142:0/3381303887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280b0290 0x7fad280b2160 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad2d800640 1 --2- 172.21.15.142:0/3381303887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad280aefa0 0x7fad280b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad2d800640 1 -- 172.21.15.142:0/3381303887 >> 172.21.15.142:0/3381303887 conn(0x7fad280b5890 msgr2=0x7fad280b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad2d800640 1 -- 172.21.15.142:0/3381303887 shutdown_connections 2024-04-01T15:23:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.884+0000 7fad2d800640 1 -- 172.21.15.142:0/3381303887 wait complete. 2024-04-01T15:23:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.886+0000 7fad2d800640 1 Processor -- start 2024-04-01T15:23:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.886+0000 7fad2d800640 1 -- start start 2024-04-01T15:23:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad2d800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad2806d8d0 0x7fad281e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad2d800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280aefa0 0x7fad281dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad2d800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad280b0290 0x7fad280b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad2d800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fad280ae370 con 0x7fad280aefa0 2024-04-01T15:23:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad2d800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fad280ae090 con 0x7fad280b0290 2024-04-01T15:23:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad2d800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fad280b26a0 con 0x7fad2806d8d0 2024-04-01T15:23:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad1fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280aefa0 0x7fad281dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad1fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280aefa0 0x7fad281dcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37764/0 (socket says 172.21.15.142:37764) 2024-04-01T15:23:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad1fe00640 1 -- 172.21.15.142:0/901728399 learned_addr learned my addr 172.21.15.142:0/901728399 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad1fe00640 1 -- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad2806d8d0 msgr2=0x7fad281e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad1fe00640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad2806d8d0 0x7fad281e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad1fe00640 1 -- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad280b0290 msgr2=0x7fad280b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad1fe00640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad280b0290 0x7fad280b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.887+0000 7fad1fe00640 1 -- 172.21.15.142:0/901728399 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad281e0460 con 0x7fad280aefa0 2024-04-01T15:23:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.888+0000 7fad1fe00640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280aefa0 0x7fad281dcdd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad1000b450 tx=0x7fad1000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.888+0000 7fad1ea00640 1 -- 172.21.15.142:0/901728399 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10015020 con 0x7fad280aefa0 2024-04-01T15:23:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.888+0000 7fad1ea00640 1 -- 172.21.15.142:0/901728399 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad10011890 con 0x7fad280aefa0 2024-04-01T15:23:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.888+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad281e0740 con 0x7fad280aefa0 2024-04-01T15:23:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.888+0000 7fad1ea00640 1 -- 172.21.15.142:0/901728399 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10011c80 con 0x7fad280aefa0 2024-04-01T15:23:46.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.888+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad280b79a0 con 0x7fad280aefa0 2024-04-01T15:23:46.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.889+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad280b0af0 con 0x7fad280aefa0 2024-04-01T15:23:46.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.890+0000 7fad1ea00640 1 -- 172.21.15.142:0/901728399 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad10018020 con 0x7fad280aefa0 2024-04-01T15:23:46.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.891+0000 7fad1ea00640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fad0406c920 0x7fad0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:46.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.891+0000 7fad1ea00640 1 -- 172.21.15.142:0/901728399 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fad1008bd50 con 0x7fad280aefa0 2024-04-01T15:23:46.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.892+0000 7fad26a00640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fad0406c920 0x7fad0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:46.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.893+0000 7fad26a00640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fad0406c920 0x7fad0406ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad18000f60 tx=0x7fad180079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:46.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:46.895+0000 7fad1ea00640 1 -- 172.21.15.142:0/901728399 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fad1001f020 con 0x7fad280aefa0 2024-04-01T15:23:47.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.091+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad2809b6e0 con 0x7fad0406c920 2024-04-01T15:23:47.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.099+0000 7fad1ea00640 1 -- 172.21.15.142:0/901728399 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251828 (secure 0 0 0) 0x7fad18005080 con 0x7fad0406c920 2024-04-01T15:23:47.103 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:23:47.104 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:23:47.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fad0406c920 msgr2=0x7fad0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fad0406c920 0x7fad0406ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad18000f60 tx=0x7fad180079d0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280aefa0 msgr2=0x7fad281dcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280aefa0 0x7fad281dcdd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad1000b450 tx=0x7fad1000b910 comp rx=0 tx=0).stop 2024-04-01T15:23:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 shutdown_connections 2024-04-01T15:23:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fad0406c920 0x7fad0406ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad280b0290 0x7fad280b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad280aefa0 0x7fad281dcdd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 --2- 172.21.15.142:0/901728399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad2806d8d0 0x7fad281e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 >> 172.21.15.142:0/901728399 conn(0x7fad280b5890 msgr2=0x7fad281ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 shutdown_connections 2024-04-01T15:23:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.105+0000 7fad2d800640 1 -- 172.21.15.142:0/901728399 wait complete. 2024-04-01T15:23:47.125 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-01T15:23:46.600914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3088384,"data_stored":1850548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007742"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747701+0000","last_change":"2024-04-01T15:21:58.539004+0000","last_active":"2024-04-01T15:22:39.747701+0000","last_peered":"2024-04-01T15:22:39.747701+0000","last_clean":"2024-04-01T15:22:39.747701+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:22:39.747701+0000","last_undegraded":"2024-04-01T15:22:39.747701+0000","last_fullsized":"2024-04-01T15:22:39.747701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737668+0000","last_change":"2024-04-01T15:21:58.524238+0000","last_active":"2024-04-01T15:22:39.737668+0000","last_peered":"2024-04-01T15:22:39.737668+0000","last_clean":"2024-04-01T15:22:39.737668+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:22:39.737668+0000","last_undegraded":"2024-04-01T15:22:39.737668+0000","last_fullsized":"2024-04-01T15:22:39.737668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748607+0000","last_change":"2024-04-01T15:21:58.526226+0000","last_active":"2024-04-01T15:22:39.748607+0000","last_peered":"2024-04-01T15:22:39.748607+0000","last_clean":"2024-04-01T15:22:39.748607+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:22:39.748607+0000","last_undegraded":"2024-04-01T15:22:39.748607+0000","last_fullsized":"2024-04-01T15:22:39.748607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732299+0000","last_change":"2024-04-01T15:21:58.541297+0000","last_active":"2024-04-01T15:22:39.732299+0000","last_peered":"2024-04-01T15:22:39.732299+0000","last_clean":"2024-04-01T15:22:39.732299+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:22:39.732299+0000","last_undegraded":"2024-04-01T15:22:39.732299+0000","last_fullsized":"2024-04-01T15:22:39.732299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747043+0000","last_change":"2024-04-01T15:21:58.518814+0000","last_active":"2024-04-01T15:22:39.747043+0000","last_peered":"2024-04-01T15:22:39.747043+0000","last_clean":"2024-04-01T15:22:39.747043+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:22:39.747043+0000","last_undegraded":"2024-04-01T15:22:39.747043+0000","last_fullsized":"2024-04-01T15:22:39.747043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.755776+0000","last_change":"2024-04-01T15:22:39.753380+0000","last_active":"2024-04-01T15:22:39.755776+0000","last_peered":"2024-04-01T15:22:39.755776+0000","last_clean":"2024-04-01T15:22:39.755776+0000","last_became_active":"2024-04-01T15:22:39.752359+0000","last_became_peered":"2024-04-01T15:22:39.752359+0000","last_unstale":"2024-04-01T15:22:39.755776+0000","last_undegraded":"2024-04-01T15:22:39.755776+0000","last_fullsized":"2024-04-01T15:22:39.755776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747048+0000","last_change":"2024-04-01T15:21:58.522961+0000","last_active":"2024-04-01T15:22:39.747048+0000","last_peered":"2024-04-01T15:22:39.747048+0000","last_clean":"2024-04-01T15:22:39.747048+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:22:39.747048+0000","last_undegraded":"2024-04-01T15:22:39.747048+0000","last_fullsized":"2024-04-01T15:22:39.747048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:51:33.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751116+0000","last_change":"2024-04-01T15:21:58.530231+0000","last_active":"2024-04-01T15:22:39.751116+0000","last_peered":"2024-04-01T15:22:39.751116+0000","last_clean":"2024-04-01T15:22:39.751116+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:22:39.751116+0000","last_undegraded":"2024-04-01T15:22:39.751116+0000","last_fullsized":"2024-04-01T15:22:39.751116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747834+0000","last_change":"2024-04-01T15:21:58.526959+0000","last_active":"2024-04-01T15:22:39.747834+0000","last_peered":"2024-04-01T15:22:39.747834+0000","last_clean":"2024-04-01T15:22:39.747834+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:22:39.747834+0000","last_undegraded":"2024-04-01T15:22:39.747834+0000","last_fullsized":"2024-04-01T15:22:39.747834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.733705+0000","last_change":"2024-04-01T15:21:58.529489+0000","last_active":"2024-04-01T15:22:39.733705+0000","last_peered":"2024-04-01T15:22:39.733705+0000","last_clean":"2024-04-01T15:22:39.733705+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:22:39.733705+0000","last_undegraded":"2024-04-01T15:22:39.733705+0000","last_fullsized":"2024-04-01T15:22:39.733705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734352+0000","last_change":"2024-04-01T15:21:58.527803+0000","last_active":"2024-04-01T15:22:39.734352+0000","last_peered":"2024-04-01T15:22:39.734352+0000","last_clean":"2024-04-01T15:22:39.734352+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:22:39.734352+0000","last_undegraded":"2024-04-01T15:22:39.734352+0000","last_fullsized":"2024-04-01T15:22:39.734352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748645+0000","last_change":"2024-04-01T15:21:58.535848+0000","last_active":"2024-04-01T15:22:39.748645+0000","last_peered":"2024-04-01T15:22:39.748645+0000","last_clean":"2024-04-01T15:22:39.748645+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:22:39.748645+0000","last_undegraded":"2024-04-01T15:22:39.748645+0000","last_fullsized":"2024-04-01T15:22:39.748645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752869+0000","last_change":"2024-04-01T15:21:58.528912+0000","last_active":"2024-04-01T15:22:39.752869+0000","last_peered":"2024-04-01T15:22:39.752869+0000","last_clean":"2024-04-01T15:22:39.752869+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:22:39.752869+0000","last_undegraded":"2024-04-01T15:22:39.752869+0000","last_fullsized":"2024-04-01T15:22:39.752869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748368+0000","last_change":"2024-04-01T15:21:58.529847+0000","last_active":"2024-04-01T15:22:39.748368+0000","last_peered":"2024-04-01T15:22:39.748368+0000","last_clean":"2024-04-01T15:22:39.748368+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:22:39.748368+0000","last_undegraded":"2024-04-01T15:22:39.748368+0000","last_fullsized":"2024-04-01T15:22:39.748368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:44:07.006946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737739+0000","last_change":"2024-04-01T15:21:58.535414+0000","last_active":"2024-04-01T15:22:39.737739+0000","last_peered":"2024-04-01T15:22:39.737739+0000","last_clean":"2024-04-01T15:22:39.737739+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:22:39.737739+0000","last_undegraded":"2024-04-01T15:22:39.737739+0000","last_fullsized":"2024-04-01T15:22:39.737739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.730860+0000","last_change":"2024-04-01T15:21:58.522234+0000","last_active":"2024-04-01T15:22:39.730860+0000","last_peered":"2024-04-01T15:22:39.730860+0000","last_clean":"2024-04-01T15:22:39.730860+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:22:39.730860+0000","last_undegraded":"2024-04-01T15:22:39.730860+0000","last_fullsized":"2024-04-01T15:22:39.730860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732253+0000","last_change":"2024-04-01T15:21:58.531397+0000","last_active":"2024-04-01T15:22:39.732253+0000","last_peered":"2024-04-01T15:22:39.732253+0000","last_clean":"2024-04-01T15:22:39.732253+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:22:39.732253+0000","last_undegraded":"2024-04-01T15:22:39.732253+0000","last_fullsized":"2024-04-01T15:22:39.732253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728872+0000","last_change":"2024-04-01T15:21:58.522828+0000","last_active":"2024-04-01T15:22:39.728872+0000","last_peered":"2024-04-01T15:22:39.728872+0000","last_clean":"2024-04-01T15:22:39.728872+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:22:39.728872+0000","last_undegraded":"2024-04-01T15:22:39.728872+0000","last_fullsized":"2024-04-01T15:22:39.728872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747574+0000","last_change":"2024-04-01T15:21:58.532575+0000","last_active":"2024-04-01T15:22:39.747574+0000","last_peered":"2024-04-01T15:22:39.747574+0000","last_clean":"2024-04-01T15:22:39.747574+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:22:39.747574+0000","last_undegraded":"2024-04-01T15:22:39.747574+0000","last_fullsized":"2024-04-01T15:22:39.747574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731248+0000","last_change":"2024-04-01T15:21:58.530543+0000","last_active":"2024-04-01T15:22:39.731248+0000","last_peered":"2024-04-01T15:22:39.731248+0000","last_clean":"2024-04-01T15:22:39.731248+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:22:39.731248+0000","last_undegraded":"2024-04-01T15:22:39.731248+0000","last_fullsized":"2024-04-01T15:22:39.731248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748156+0000","last_change":"2024-04-01T15:21:58.528377+0000","last_active":"2024-04-01T15:22:39.748156+0000","last_peered":"2024-04-01T15:22:39.748156+0000","last_clean":"2024-04-01T15:22:39.748156+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:22:39.748156+0000","last_undegraded":"2024-04-01T15:22:39.748156+0000","last_fullsized":"2024-04-01T15:22:39.748156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:56:09.008728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731285+0000","last_change":"2024-04-01T15:21:58.530746+0000","last_active":"2024-04-01T15:22:39.731285+0000","last_peered":"2024-04-01T15:22:39.731285+0000","last_clean":"2024-04-01T15:22:39.731285+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:22:39.731285+0000","last_undegraded":"2024-04-01T15:22:39.731285+0000","last_fullsized":"2024-04-01T15:22:39.731285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749986+0000","last_change":"2024-04-01T15:21:58.516408+0000","last_active":"2024-04-01T15:22:39.749986+0000","last_peered":"2024-04-01T15:22:39.749986+0000","last_clean":"2024-04-01T15:22:39.749986+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:22:39.749986+0000","last_undegraded":"2024-04-01T15:22:39.749986+0000","last_fullsized":"2024-04-01T15:22:39.749986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731046+0000","last_change":"2024-04-01T15:21:58.525868+0000","last_active":"2024-04-01T15:22:39.731046+0000","last_peered":"2024-04-01T15:22:39.731046+0000","last_clean":"2024-04-01T15:22:39.731046+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:22:39.731046+0000","last_undegraded":"2024-04-01T15:22:39.731046+0000","last_fullsized":"2024-04-01T15:22:39.731046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754513+0000","last_change":"2024-04-01T15:21:58.531952+0000","last_active":"2024-04-01T15:22:39.754513+0000","last_peered":"2024-04-01T15:22:39.754513+0000","last_clean":"2024-04-01T15:22:39.754513+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:22:39.754513+0000","last_undegraded":"2024-04-01T15:22:39.754513+0000","last_fullsized":"2024-04-01T15:22:39.754513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.733953+0000","last_change":"2024-04-01T15:21:58.517341+0000","last_active":"2024-04-01T15:22:39.733953+0000","last_peered":"2024-04-01T15:22:39.733953+0000","last_clean":"2024-04-01T15:22:39.733953+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:22:39.733953+0000","last_undegraded":"2024-04-01T15:22:39.733953+0000","last_fullsized":"2024-04-01T15:22:39.733953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737920+0000","last_change":"2024-04-01T15:21:58.535087+0000","last_active":"2024-04-01T15:22:39.737920+0000","last_peered":"2024-04-01T15:22:39.737920+0000","last_clean":"2024-04-01T15:22:39.737920+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:22:39.737920+0000","last_undegraded":"2024-04-01T15:22:39.737920+0000","last_fullsized":"2024-04-01T15:22:39.737920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752727+0000","last_change":"2024-04-01T15:21:58.531487+0000","last_active":"2024-04-01T15:22:39.752727+0000","last_peered":"2024-04-01T15:22:39.752727+0000","last_clean":"2024-04-01T15:22:39.752727+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:22:39.752727+0000","last_undegraded":"2024-04-01T15:22:39.752727+0000","last_fullsized":"2024-04-01T15:22:39.752727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748164+0000","last_change":"2024-04-01T15:21:58.531305+0000","last_active":"2024-04-01T15:22:39.748164+0000","last_peered":"2024-04-01T15:22:39.748164+0000","last_clean":"2024-04-01T15:22:39.748164+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:22:39.748164+0000","last_undegraded":"2024-04-01T15:22:39.748164+0000","last_fullsized":"2024-04-01T15:22:39.748164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731539+0000","last_change":"2024-04-01T15:21:58.530998+0000","last_active":"2024-04-01T15:22:39.731539+0000","last_peered":"2024-04-01T15:22:39.731539+0000","last_clean":"2024-04-01T15:22:39.731539+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:22:39.731539+0000","last_undegraded":"2024-04-01T15:22:39.731539+0000","last_fullsized":"2024-04-01T15:22:39.731539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728576+0000","last_change":"2024-04-01T15:21:58.523119+0000","last_active":"2024-04-01T15:22:39.728576+0000","last_peered":"2024-04-01T15:22:39.728576+0000","last_clean":"2024-04-01T15:22:39.728576+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:22:39.728576+0000","last_undegraded":"2024-04-01T15:22:39.728576+0000","last_fullsized":"2024-04-01T15:22:39.728576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.730767+0000","last_change":"2024-04-01T15:21:58.514302+0000","last_active":"2024-04-01T15:22:39.730767+0000","last_peered":"2024-04-01T15:22:39.730767+0000","last_clean":"2024-04-01T15:22:39.730767+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:22:39.730767+0000","last_undegraded":"2024-04-01T15:22:39.730767+0000","last_fullsized":"2024-04-01T15:22:39.730767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748155+0000","last_change":"2024-04-01T15:21:58.528525+0000","last_active":"2024-04-01T15:22:39.748155+0000","last_peered":"2024-04-01T15:22:39.748155+0000","last_clean":"2024-04-01T15:22:39.748155+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:22:39.748155+0000","last_undegraded":"2024-04-01T15:22:39.748155+0000","last_fullsized":"2024-04-01T15:22:39.748155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:58.054203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.753403+0000","last_change":"2024-04-01T15:21:57.523557+0000","last_active":"2024-04-01T15:22:39.753403+0000","last_peered":"2024-04-01T15:22:39.753403+0000","last_clean":"2024-04-01T15:22:39.753403+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:22:39.753403+0000","last_undegraded":"2024-04-01T15:22:39.753403+0000","last_fullsized":"2024-04-01T15:22:39.753403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748537+0000","last_change":"2024-04-01T15:21:58.531570+0000","last_active":"2024-04-01T15:22:39.748537+0000","last_peered":"2024-04-01T15:22:39.748537+0000","last_clean":"2024-04-01T15:22:39.748537+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:22:39.748537+0000","last_undegraded":"2024-04-01T15:22:39.748537+0000","last_fullsized":"2024-04-01T15:22:39.748537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732276+0000","last_change":"2024-04-01T15:21:57.519248+0000","last_active":"2024-04-01T15:22:39.732276+0000","last_peered":"2024-04-01T15:22:39.732276+0000","last_clean":"2024-04-01T15:22:39.732276+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:22:39.732276+0000","last_undegraded":"2024-04-01T15:22:39.732276+0000","last_fullsized":"2024-04-01T15:22:39.732276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751667+0000","last_change":"2024-04-01T15:21:57.518727+0000","last_active":"2024-04-01T15:22:39.751667+0000","last_peered":"2024-04-01T15:22:39.751667+0000","last_clean":"2024-04-01T15:22:39.751667+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:22:39.751667+0000","last_undegraded":"2024-04-01T15:22:39.751667+0000","last_fullsized":"2024-04-01T15:22:39.751667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:15:36.993209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752004+0000","last_change":"2024-04-01T15:21:58.527894+0000","last_active":"2024-04-01T15:22:39.752004+0000","last_peered":"2024-04-01T15:22:39.752004+0000","last_clean":"2024-04-01T15:22:39.752004+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:22:39.752004+0000","last_undegraded":"2024-04-01T15:22:39.752004+0000","last_fullsized":"2024-04-01T15:22:39.752004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731247+0000","last_change":"2024-04-01T15:21:57.534982+0000","last_active":"2024-04-01T15:22:39.731247+0000","last_peered":"2024-04-01T15:22:39.731247+0000","last_clean":"2024-04-01T15:22:39.731247+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:22:39.731247+0000","last_undegraded":"2024-04-01T15:22:39.731247+0000","last_fullsized":"2024-04-01T15:22:39.731247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737161+0000","last_change":"2024-04-01T15:21:58.525017+0000","last_active":"2024-04-01T15:22:39.737161+0000","last_peered":"2024-04-01T15:22:39.737161+0000","last_clean":"2024-04-01T15:22:39.737161+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:22:39.737161+0000","last_undegraded":"2024-04-01T15:22:39.737161+0000","last_fullsized":"2024-04-01T15:22:39.737161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734537+0000","last_change":"2024-04-01T15:21:57.528840+0000","last_active":"2024-04-01T15:22:39.734537+0000","last_peered":"2024-04-01T15:22:39.734537+0000","last_clean":"2024-04-01T15:22:39.734537+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:22:39.734537+0000","last_undegraded":"2024-04-01T15:22:39.734537+0000","last_fullsized":"2024-04-01T15:22:39.734537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732656+0000","last_change":"2024-04-01T15:21:58.529422+0000","last_active":"2024-04-01T15:22:39.732656+0000","last_peered":"2024-04-01T15:22:39.732656+0000","last_clean":"2024-04-01T15:22:39.732656+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:22:39.732656+0000","last_undegraded":"2024-04-01T15:22:39.732656+0000","last_fullsized":"2024-04-01T15:22:39.732656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732852+0000","last_change":"2024-04-01T15:21:57.528345+0000","last_active":"2024-04-01T15:22:39.732852+0000","last_peered":"2024-04-01T15:22:39.732852+0000","last_clean":"2024-04-01T15:22:39.732852+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:22:39.732852+0000","last_undegraded":"2024-04-01T15:22:39.732852+0000","last_fullsized":"2024-04-01T15:22:39.732852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749777+0000","last_change":"2024-04-01T15:21:58.529376+0000","last_active":"2024-04-01T15:22:39.749777+0000","last_peered":"2024-04-01T15:22:39.749777+0000","last_clean":"2024-04-01T15:22:39.749777+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:22:39.749777+0000","last_undegraded":"2024-04-01T15:22:39.749777+0000","last_fullsized":"2024-04-01T15:22:39.749777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738000+0000","last_change":"2024-04-01T15:21:57.526610+0000","last_active":"2024-04-01T15:22:39.738000+0000","last_peered":"2024-04-01T15:22:39.738000+0000","last_clean":"2024-04-01T15:22:39.738000+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:22:39.738000+0000","last_undegraded":"2024-04-01T15:22:39.738000+0000","last_fullsized":"2024-04-01T15:22:39.738000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748837+0000","last_change":"2024-04-01T15:21:58.537476+0000","last_active":"2024-04-01T15:22:39.748837+0000","last_peered":"2024-04-01T15:22:39.748837+0000","last_clean":"2024-04-01T15:22:39.748837+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:22:39.748837+0000","last_undegraded":"2024-04-01T15:22:39.748837+0000","last_fullsized":"2024-04-01T15:22:39.748837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731532+0000","last_change":"2024-04-01T15:21:57.513766+0000","last_active":"2024-04-01T15:22:39.731532+0000","last_peered":"2024-04-01T15:22:39.731532+0000","last_clean":"2024-04-01T15:22:39.731532+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:22:39.731532+0000","last_undegraded":"2024-04-01T15:22:39.731532+0000","last_fullsized":"2024-04-01T15:22:39.731532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747415+0000","last_change":"2024-04-01T15:21:58.539751+0000","last_active":"2024-04-01T15:22:39.747415+0000","last_peered":"2024-04-01T15:22:39.747415+0000","last_clean":"2024-04-01T15:22:39.747415+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:22:39.747415+0000","last_undegraded":"2024-04-01T15:22:39.747415+0000","last_fullsized":"2024-04-01T15:22:39.747415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748814+0000","last_change":"2024-04-01T15:21:57.520158+0000","last_active":"2024-04-01T15:22:39.748814+0000","last_peered":"2024-04-01T15:22:39.748814+0000","last_clean":"2024-04-01T15:22:39.748814+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:22:39.748814+0000","last_undegraded":"2024-04-01T15:22:39.748814+0000","last_fullsized":"2024-04-01T15:22:39.748814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748643+0000","last_change":"2024-04-01T15:21:58.532249+0000","last_active":"2024-04-01T15:22:39.748643+0000","last_peered":"2024-04-01T15:22:39.748643+0000","last_clean":"2024-04-01T15:22:39.748643+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:22:39.748643+0000","last_undegraded":"2024-04-01T15:22:39.748643+0000","last_fullsized":"2024-04-01T15:22:39.748643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.229948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731604+0000","last_change":"2024-04-01T15:21:57.528780+0000","last_active":"2024-04-01T15:22:39.731604+0000","last_peered":"2024-04-01T15:22:39.731604+0000","last_clean":"2024-04-01T15:22:39.731604+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:22:39.731604+0000","last_undegraded":"2024-04-01T15:22:39.731604+0000","last_fullsized":"2024-04-01T15:22:39.731604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747190+0000","last_change":"2024-04-01T15:21:58.528458+0000","last_active":"2024-04-01T15:22:39.747190+0000","last_peered":"2024-04-01T15:22:39.747190+0000","last_clean":"2024-04-01T15:22:39.747190+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:22:39.747190+0000","last_undegraded":"2024-04-01T15:22:39.747190+0000","last_fullsized":"2024-04-01T15:22:39.747190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731732+0000","last_change":"2024-04-01T15:21:57.528026+0000","last_active":"2024-04-01T15:22:39.731732+0000","last_peered":"2024-04-01T15:22:39.731732+0000","last_clean":"2024-04-01T15:22:39.731732+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:22:39.731732+0000","last_undegraded":"2024-04-01T15:22:39.731732+0000","last_fullsized":"2024-04-01T15:22:39.731732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731062+0000","last_change":"2024-04-01T15:21:58.514047+0000","last_active":"2024-04-01T15:22:39.731062+0000","last_peered":"2024-04-01T15:22:39.731062+0000","last_clean":"2024-04-01T15:22:39.731062+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:22:39.731062+0000","last_undegraded":"2024-04-01T15:22:39.731062+0000","last_fullsized":"2024-04-01T15:22:39.731062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728412+0000","last_change":"2024-04-01T15:21:57.517184+0000","last_active":"2024-04-01T15:22:39.728412+0000","last_peered":"2024-04-01T15:22:39.728412+0000","last_clean":"2024-04-01T15:22:39.728412+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:22:39.728412+0000","last_undegraded":"2024-04-01T15:22:39.728412+0000","last_fullsized":"2024-04-01T15:22:39.728412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746976+0000","last_change":"2024-04-01T15:21:58.529946+0000","last_active":"2024-04-01T15:22:39.746976+0000","last_peered":"2024-04-01T15:22:39.746976+0000","last_clean":"2024-04-01T15:22:39.746976+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:22:39.746976+0000","last_undegraded":"2024-04-01T15:22:39.746976+0000","last_fullsized":"2024-04-01T15:22:39.746976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748524+0000","last_change":"2024-04-01T15:21:57.519642+0000","last_active":"2024-04-01T15:22:39.748524+0000","last_peered":"2024-04-01T15:22:39.748524+0000","last_clean":"2024-04-01T15:22:39.748524+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:22:39.748524+0000","last_undegraded":"2024-04-01T15:22:39.748524+0000","last_fullsized":"2024-04-01T15:22:39.748524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:09:07.894019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747731+0000","last_change":"2024-04-01T15:21:58.529121+0000","last_active":"2024-04-01T15:22:39.747731+0000","last_peered":"2024-04-01T15:22:39.747731+0000","last_clean":"2024-04-01T15:22:39.747731+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:22:39.747731+0000","last_undegraded":"2024-04-01T15:22:39.747731+0000","last_fullsized":"2024-04-01T15:22:39.747731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.729158+0000","last_change":"2024-04-01T15:21:57.514455+0000","last_active":"2024-04-01T15:22:39.729158+0000","last_peered":"2024-04-01T15:22:39.729158+0000","last_clean":"2024-04-01T15:22:39.729158+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:22:39.729158+0000","last_undegraded":"2024-04-01T15:22:39.729158+0000","last_fullsized":"2024-04-01T15:22:39.729158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747837+0000","last_change":"2024-04-01T15:21:58.535610+0000","last_active":"2024-04-01T15:22:39.747837+0000","last_peered":"2024-04-01T15:22:39.747837+0000","last_clean":"2024-04-01T15:22:39.747837+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:22:39.747837+0000","last_undegraded":"2024-04-01T15:22:39.747837+0000","last_fullsized":"2024-04-01T15:22:39.747837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738118+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:22:39.738118+0000","last_peered":"2024-04-01T15:22:39.738118+0000","last_clean":"2024-04-01T15:22:39.738118+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:22:39.738118+0000","last_undegraded":"2024-04-01T15:22:39.738118+0000","last_fullsized":"2024-04-01T15:22:39.738118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.740524+0000","last_change":"2024-04-01T15:22:39.740524+0000","last_active":"2024-04-01T15:22:39.740524+0000","last_peered":"2024-04-01T15:22:39.740524+0000","last_clean":"2024-04-01T15:22:39.740524+0000","last_became_active":"2024-04-01T15:22:39.739729+0000","last_became_peered":"2024-04-01T15:22:39.739729+0000","last_unstale":"2024-04-01T15:22:39.740524+0000","last_undegraded":"2024-04-01T15:22:39.740524+0000","last_fullsized":"2024-04-01T15:22:39.740524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:42.451490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.729348+0000","last_change":"2024-04-01T15:21:57.532167+0000","last_active":"2024-04-01T15:22:39.729348+0000","last_peered":"2024-04-01T15:22:39.729348+0000","last_clean":"2024-04-01T15:22:39.729348+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:22:39.729348+0000","last_undegraded":"2024-04-01T15:22:39.729348+0000","last_fullsized":"2024-04-01T15:22:39.729348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.745212+0000","last_change":"2024-04-01T15:22:39.741396+0000","last_active":"2024-04-01T15:22:39.745212+0000","last_peered":"2024-04-01T15:22:39.745212+0000","last_clean":"2024-04-01T15:22:39.745212+0000","last_became_active":"2024-04-01T15:22:39.740443+0000","last_became_peered":"2024-04-01T15:22:39.740443+0000","last_unstale":"2024-04-01T15:22:39.745212+0000","last_undegraded":"2024-04-01T15:22:39.745212+0000","last_fullsized":"2024-04-01T15:22:39.745212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:25:59.110797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746901+0000","last_change":"2024-04-01T15:21:47.878530+0000","last_active":"2024-04-01T15:22:39.746901+0000","last_peered":"2024-04-01T15:22:39.746901+0000","last_clean":"2024-04-01T15:22:39.746901+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:22:39.746901+0000","last_undegraded":"2024-04-01T15:22:39.746901+0000","last_fullsized":"2024-04-01T15:22:39.746901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_clean_scrub_stamp":"2024-04-01T15:21:46.852307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:25:18.137507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731374+0000","last_change":"2024-04-01T15:21:57.530394+0000","last_active":"2024-04-01T15:22:39.731374+0000","last_peered":"2024-04-01T15:22:39.731374+0000","last_clean":"2024-04-01T15:22:39.731374+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:22:39.731374+0000","last_undegraded":"2024-04-01T15:22:39.731374+0000","last_fullsized":"2024-04-01T15:22:39.731374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752344+0000","last_change":"2024-04-01T15:21:58.529751+0000","last_active":"2024-04-01T15:22:39.752344+0000","last_peered":"2024-04-01T15:22:39.752344+0000","last_clean":"2024-04-01T15:22:39.752344+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:22:39.752344+0000","last_undegraded":"2024-04-01T15:22:39.752344+0000","last_fullsized":"2024-04-01T15:22:39.752344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746918+0000","last_change":"2024-04-01T15:21:57.526919+0000","last_active":"2024-04-01T15:22:39.746918+0000","last_peered":"2024-04-01T15:22:39.746918+0000","last_clean":"2024-04-01T15:22:39.746918+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:22:39.746918+0000","last_undegraded":"2024-04-01T15:22:39.746918+0000","last_fullsized":"2024-04-01T15:22:39.746918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747676+0000","last_change":"2024-04-01T15:21:58.525329+0000","last_active":"2024-04-01T15:22:39.747676+0000","last_peered":"2024-04-01T15:22:39.747676+0000","last_clean":"2024-04-01T15:22:39.747676+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:22:39.747676+0000","last_undegraded":"2024-04-01T15:22:39.747676+0000","last_fullsized":"2024-04-01T15:22:39.747676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728881+0000","last_change":"2024-04-01T15:21:57.511176+0000","last_active":"2024-04-01T15:22:39.728881+0000","last_peered":"2024-04-01T15:22:39.728881+0000","last_clean":"2024-04-01T15:22:39.728881+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:22:39.728881+0000","last_undegraded":"2024-04-01T15:22:39.728881+0000","last_fullsized":"2024-04-01T15:22:39.728881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737037+0000","last_change":"2024-04-01T15:21:58.523794+0000","last_active":"2024-04-01T15:22:39.737037+0000","last_peered":"2024-04-01T15:22:39.737037+0000","last_clean":"2024-04-01T15:22:39.737037+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:22:39.737037+0000","last_undegraded":"2024-04-01T15:22:39.737037+0000","last_fullsized":"2024-04-01T15:22:39.737037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731803+0000","last_change":"2024-04-01T15:21:57.527763+0000","last_active":"2024-04-01T15:22:39.731803+0000","last_peered":"2024-04-01T15:22:39.731803+0000","last_clean":"2024-04-01T15:22:39.731803+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:22:39.731803+0000","last_undegraded":"2024-04-01T15:22:39.731803+0000","last_fullsized":"2024-04-01T15:22:39.731803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748426+0000","last_change":"2024-04-01T15:21:58.531026+0000","last_active":"2024-04-01T15:22:39.748426+0000","last_peered":"2024-04-01T15:22:39.748426+0000","last_clean":"2024-04-01T15:22:39.748426+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:22:39.748426+0000","last_undegraded":"2024-04-01T15:22:39.748426+0000","last_fullsized":"2024-04-01T15:22:39.748426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:50.706762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737539+0000","last_change":"2024-04-01T15:21:57.517159+0000","last_active":"2024-04-01T15:22:39.737539+0000","last_peered":"2024-04-01T15:22:39.737539+0000","last_clean":"2024-04-01T15:22:39.737539+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:22:39.737539+0000","last_undegraded":"2024-04-01T15:22:39.737539+0000","last_fullsized":"2024-04-01T15:22:39.737539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732520+0000","last_change":"2024-04-01T15:21:58.541348+0000","last_active":"2024-04-01T15:22:39.732520+0000","last_peered":"2024-04-01T15:22:39.732520+0000","last_clean":"2024-04-01T15:22:39.732520+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:22:39.732520+0000","last_undegraded":"2024-04-01T15:22:39.732520+0000","last_fullsized":"2024-04-01T15:22:39.732520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747695+0000","last_change":"2024-04-01T15:21:57.526914+0000","last_active":"2024-04-01T15:22:39.747695+0000","last_peered":"2024-04-01T15:22:39.747695+0000","last_clean":"2024-04-01T15:22:39.747695+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:22:39.747695+0000","last_undegraded":"2024-04-01T15:22:39.747695+0000","last_fullsized":"2024-04-01T15:22:39.747695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737407+0000","last_change":"2024-04-01T15:21:58.515834+0000","last_active":"2024-04-01T15:22:39.737407+0000","last_peered":"2024-04-01T15:22:39.737407+0000","last_clean":"2024-04-01T15:22:39.737407+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:22:39.737407+0000","last_undegraded":"2024-04-01T15:22:39.737407+0000","last_fullsized":"2024-04-01T15:22:39.737407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738464+0000","last_change":"2024-04-01T15:21:57.533452+0000","last_active":"2024-04-01T15:22:39.738464+0000","last_peered":"2024-04-01T15:22:39.738464+0000","last_clean":"2024-04-01T15:22:39.738464+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:22:39.738464+0000","last_undegraded":"2024-04-01T15:22:39.738464+0000","last_fullsized":"2024-04-01T15:22:39.738464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754786+0000","last_change":"2024-04-01T15:21:58.512191+0000","last_active":"2024-04-01T15:22:39.754786+0000","last_peered":"2024-04-01T15:22:39.754786+0000","last_clean":"2024-04-01T15:22:39.754786+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:22:39.754786+0000","last_undegraded":"2024-04-01T15:22:39.754786+0000","last_fullsized":"2024-04-01T15:22:39.754786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734713+0000","last_change":"2024-04-01T15:21:57.526196+0000","last_active":"2024-04-01T15:22:39.734713+0000","last_peered":"2024-04-01T15:22:39.734713+0000","last_clean":"2024-04-01T15:22:39.734713+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:22:39.734713+0000","last_undegraded":"2024-04-01T15:22:39.734713+0000","last_fullsized":"2024-04-01T15:22:39.734713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749441+0000","last_change":"2024-04-01T15:21:58.526739+0000","last_active":"2024-04-01T15:22:39.749441+0000","last_peered":"2024-04-01T15:22:39.749441+0000","last_clean":"2024-04-01T15:22:39.749441+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:22:39.749441+0000","last_undegraded":"2024-04-01T15:22:39.749441+0000","last_fullsized":"2024-04-01T15:22:39.749441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746750+0000","last_change":"2024-04-01T15:21:57.526924+0000","last_active":"2024-04-01T15:22:39.746750+0000","last_peered":"2024-04-01T15:22:39.746750+0000","last_clean":"2024-04-01T15:22:39.746750+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:22:39.746750+0000","last_undegraded":"2024-04-01T15:22:39.746750+0000","last_fullsized":"2024-04-01T15:22:39.746750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749243+0000","last_change":"2024-04-01T15:21:58.528396+0000","last_active":"2024-04-01T15:22:39.749243+0000","last_peered":"2024-04-01T15:22:39.749243+0000","last_clean":"2024-04-01T15:22:39.749243+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:22:39.749243+0000","last_undegraded":"2024-04-01T15:22:39.749243+0000","last_fullsized":"2024-04-01T15:22:39.749243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:50.943225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737525+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:22:39.737525+0000","last_peered":"2024-04-01T15:22:39.737525+0000","last_clean":"2024-04-01T15:22:39.737525+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:22:39.737525+0000","last_undegraded":"2024-04-01T15:22:39.737525+0000","last_fullsized":"2024-04-01T15:22:39.737525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:09.572891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751390+0000","last_change":"2024-04-01T15:21:58.529955+0000","last_active":"2024-04-01T15:22:39.751390+0000","last_peered":"2024-04-01T15:22:39.751390+0000","last_clean":"2024-04-01T15:22:39.751390+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:22:39.751390+0000","last_undegraded":"2024-04-01T15:22:39.751390+0000","last_fullsized":"2024-04-01T15:22:39.751390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737822+0000","last_change":"2024-04-01T15:21:57.526620+0000","last_active":"2024-04-01T15:22:39.737822+0000","last_peered":"2024-04-01T15:22:39.737822+0000","last_clean":"2024-04-01T15:22:39.737822+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:22:39.737822+0000","last_undegraded":"2024-04-01T15:22:39.737822+0000","last_fullsized":"2024-04-01T15:22:39.737822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.753152+0000","last_change":"2024-04-01T15:21:58.534484+0000","last_active":"2024-04-01T15:22:39.753152+0000","last_peered":"2024-04-01T15:22:39.753152+0000","last_clean":"2024-04-01T15:22:39.753152+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:22:39.753152+0000","last_undegraded":"2024-04-01T15:22:39.753152+0000","last_fullsized":"2024-04-01T15:22:39.753152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747363+0000","last_change":"2024-04-01T15:21:57.531639+0000","last_active":"2024-04-01T15:22:39.747363+0000","last_peered":"2024-04-01T15:22:39.747363+0000","last_clean":"2024-04-01T15:22:39.747363+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:22:39.747363+0000","last_undegraded":"2024-04-01T15:22:39.747363+0000","last_fullsized":"2024-04-01T15:22:39.747363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732012+0000","last_change":"2024-04-01T15:21:58.523366+0000","last_active":"2024-04-01T15:22:39.732012+0000","last_peered":"2024-04-01T15:22:39.732012+0000","last_clean":"2024-04-01T15:22:39.732012+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:22:39.732012+0000","last_undegraded":"2024-04-01T15:22:39.732012+0000","last_fullsized":"2024-04-01T15:22:39.732012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732440+0000","last_change":"2024-04-01T15:21:58.526457+0000","last_active":"2024-04-01T15:22:39.732440+0000","last_peered":"2024-04-01T15:22:39.732440+0000","last_clean":"2024-04-01T15:22:39.732440+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:22:39.732440+0000","last_undegraded":"2024-04-01T15:22:39.732440+0000","last_fullsized":"2024-04-01T15:22:39.732440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747278+0000","last_change":"2024-04-01T15:21:57.534510+0000","last_active":"2024-04-01T15:22:39.747278+0000","last_peered":"2024-04-01T15:22:39.747278+0000","last_clean":"2024-04-01T15:22:39.747278+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:22:39.747278+0000","last_undegraded":"2024-04-01T15:22:39.747278+0000","last_fullsized":"2024-04-01T15:22:39.747278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754630+0000","last_change":"2024-04-01T15:22:39.750841+0000","last_active":"2024-04-01T15:22:39.754630+0000","last_peered":"2024-04-01T15:22:39.754630+0000","last_clean":"2024-04-01T15:22:39.754630+0000","last_became_active":"2024-04-01T15:22:39.750255+0000","last_became_peered":"2024-04-01T15:22:39.750255+0000","last_unstale":"2024-04-01T15:22:39.754630+0000","last_undegraded":"2024-04-01T15:22:39.754630+0000","last_fullsized":"2024-04-01T15:22:39.754630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747532+0000","last_change":"2024-04-01T15:21:57.533797+0000","last_active":"2024-04-01T15:22:39.747532+0000","last_peered":"2024-04-01T15:22:39.747532+0000","last_clean":"2024-04-01T15:22:39.747532+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:22:39.747532+0000","last_undegraded":"2024-04-01T15:22:39.747532+0000","last_fullsized":"2024-04-01T15:22:39.747532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:16:16.205030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749155+0000","last_change":"2024-04-01T15:21:58.524922+0000","last_active":"2024-04-01T15:22:39.749155+0000","last_peered":"2024-04-01T15:22:39.749155+0000","last_clean":"2024-04-01T15:22:39.749155+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:22:39.749155+0000","last_undegraded":"2024-04-01T15:22:39.749155+0000","last_fullsized":"2024-04-01T15:22:39.749155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754618+0000","last_change":"2024-04-01T15:21:57.518934+0000","last_active":"2024-04-01T15:22:39.754618+0000","last_peered":"2024-04-01T15:22:39.754618+0000","last_clean":"2024-04-01T15:22:39.754618+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:22:39.754618+0000","last_undegraded":"2024-04-01T15:22:39.754618+0000","last_fullsized":"2024-04-01T15:22:39.754618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754328+0000","last_change":"2024-04-01T15:21:58.538259+0000","last_active":"2024-04-01T15:22:39.754328+0000","last_peered":"2024-04-01T15:22:39.754328+0000","last_clean":"2024-04-01T15:22:39.754328+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:22:39.754328+0000","last_undegraded":"2024-04-01T15:22:39.754328+0000","last_fullsized":"2024-04-01T15:22:39.754328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749835+0000","last_change":"2024-04-01T15:21:57.524507+0000","last_active":"2024-04-01T15:22:39.749835+0000","last_peered":"2024-04-01T15:22:39.749835+0000","last_clean":"2024-04-01T15:22:39.749835+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:22:39.749835+0000","last_undegraded":"2024-04-01T15:22:39.749835+0000","last_fullsized":"2024-04-01T15:22:39.749835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:29:44.659776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":674074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":84736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":83214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":83250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":84736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":83124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":83284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":674130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:23:47.129 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-01T15:23:47.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:23:47.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.376+0000 7f6cd1e00640 1 Processor -- start 2024-04-01T15:23:47.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.376+0000 7f6cd1e00640 1 -- start start 2024-04-01T15:23:47.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.377+0000 7f6cd1e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6ccc0aefa0 0x7f6ccc0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.377+0000 7f6cd1e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0b0290 0x7f6ccc0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.377+0000 7f6cd1e00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ccc06dcb0 con 0x7f6ccc06d8d0 2024-04-01T15:23:47.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.377+0000 7f6cd1e00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f6ccc0b1790 con 0x7f6ccc0aefa0 2024-04-01T15:23:47.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.377+0000 7f6cd1e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6ccc0b14b0 con 0x7f6ccc0b0290 2024-04-01T15:23:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.378+0000 7f6ccb400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0b0290 0x7f6ccc0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.378+0000 7f6cca000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6ccc0aefa0 0x7f6ccc0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.378+0000 7f6ccb400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0b0290 0x7f6ccc0b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:38316/0 (socket says 172.21.15.142:38316) 2024-04-01T15:23:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.378+0000 7f6ccb400640 1 -- 172.21.15.142:0/1502804347 learned_addr learned my addr 172.21.15.142:0/1502804347 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.379+0000 7f6cca000640 1 -- 172.21.15.142:0/1502804347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0b0290 msgr2=0x7f6ccc0b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:47.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.379+0000 7f6cca000640 1 --2- 172.21.15.142:0/1502804347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0b0290 0x7f6ccc0b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.379+0000 7f6cca000640 1 -- 172.21.15.142:0/1502804347 >> v1:172.21.15.179:6789/0 conn(0x7f6ccc06d8d0 legacy=0x7f6ccc0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.379+0000 7f6cca000640 1 -- 172.21.15.142:0/1502804347 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc0b53b0 con 0x7f6ccc0aefa0 2024-04-01T15:23:47.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.379+0000 7f6ccb400640 1 --2- 172.21.15.142:0/1502804347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0b0290 0x7f6ccc0b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:23:47.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.380+0000 7f6cca000640 1 --2- 172.21.15.142:0/1502804347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ccc0aefa0 0x7f6ccc0b1c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009d90 tx=0x7f6cb802e0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c88bc59d7e8a163a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:47.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.381+0000 7f6cc9600640 1 -- 172.21.15.142:0/1502804347 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb803b070 con 0x7f6ccc0aefa0 2024-04-01T15:23:47.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.381+0000 7f6cc9600640 1 -- 172.21.15.142:0/1502804347 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb8036440 con 0x7f6ccc0aefa0 2024-04-01T15:23:47.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.381+0000 7f6cc9600640 1 -- 172.21.15.142:0/1502804347 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8036810 con 0x7f6ccc0aefa0 2024-04-01T15:23:47.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.381+0000 7f6cd1e00640 1 -- 172.21.15.142:0/1502804347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ccc0aefa0 msgr2=0x7f6ccc0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.381+0000 7f6cd1e00640 1 --2- 172.21.15.142:0/1502804347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ccc0aefa0 0x7f6ccc0b1c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009d90 tx=0x7f6cb802e0c0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.382+0000 7f6cd1e00640 1 -- 172.21.15.142:0/1502804347 shutdown_connections 2024-04-01T15:23:47.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.382+0000 7f6cd1e00640 1 --2- 172.21.15.142:0/1502804347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0b0290 0x7f6ccc0b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.382+0000 7f6cd1e00640 1 --2- 172.21.15.142:0/1502804347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ccc0aefa0 0x7f6ccc0b1c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.382+0000 7f6cd1e00640 1 -- 172.21.15.142:0/1502804347 >> 172.21.15.142:0/1502804347 conn(0x7f6ccc0b5890 msgr2=0x7f6ccc0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:47.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.382+0000 7f6cd1e00640 1 -- 172.21.15.142:0/1502804347 shutdown_connections 2024-04-01T15:23:47.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.382+0000 7f6cd1e00640 1 -- 172.21.15.142:0/1502804347 wait complete. 2024-04-01T15:23:47.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.384+0000 7f6cd1e00640 1 Processor -- start 2024-04-01T15:23:47.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.384+0000 7f6cd1e00640 1 -- start start 2024-04-01T15:23:47.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6cd1e00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ccc06d8d0 0x7f6ccc1e0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6cd1e00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0aefa0 0x7f6ccc09b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6cd1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b0290 0x7f6ccc1c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6cd1e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0ae370 con 0x7f6ccc0b0290 2024-04-01T15:23:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6cd1e00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0ae090 con 0x7f6ccc06d8d0 2024-04-01T15:23:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6cd1e00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6ccc0b26a0 con 0x7f6ccc0aefa0 2024-04-01T15:23:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6ccb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b0290 0x7f6ccc1c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6ccb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b0290 0x7f6ccc1c5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37766/0 (socket says 172.21.15.142:37766) 2024-04-01T15:23:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6ccb400640 1 -- 172.21.15.142:0/2743194716 learned_addr learned my addr 172.21.15.142:0/2743194716 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6ccaa00640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ccc06d8d0 0x7f6ccc1e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.385+0000 7f6cca000640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0aefa0 0x7f6ccc09b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.386+0000 7f6ccb400640 1 -- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0aefa0 msgr2=0x7f6ccc09b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.386+0000 7f6ccb400640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0aefa0 0x7f6ccc09b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.386+0000 7f6ccb400640 1 -- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ccc06d8d0 msgr2=0x7f6ccc1e0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.386+0000 7f6ccb400640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ccc06d8d0 0x7f6ccc1e0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.386+0000 7f6ccb400640 1 -- 172.21.15.142:0/2743194716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc09b780 con 0x7f6ccc0b0290 2024-04-01T15:23:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.386+0000 7f6ccb400640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b0290 0x7f6ccc1c5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400e890 tx=0x7f6cc400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.386+0000 7f6cc3400640 1 -- 172.21.15.142:0/2743194716 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4017070 con 0x7f6ccc0b0290 2024-04-01T15:23:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.386+0000 7f6cc3400640 1 -- 172.21.15.142:0/2743194716 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc4004020 con 0x7f6ccc0b0290 2024-04-01T15:23:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.387+0000 7f6cc3400640 1 -- 172.21.15.142:0/2743194716 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40043f0 con 0x7f6ccc0b0290 2024-04-01T15:23:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.387+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ccc09ba60 con 0x7f6ccc0b0290 2024-04-01T15:23:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.387+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ccc0703f0 con 0x7f6ccc0b0290 2024-04-01T15:23:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.388+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ccc0716f0 con 0x7f6ccc0b0290 2024-04-01T15:23:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.389+0000 7f6cc3400640 1 -- 172.21.15.142:0/2743194716 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6cc400c8e0 con 0x7f6ccc0b0290 2024-04-01T15:23:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.389+0000 7f6cc3400640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6cac06c8f0 0x7f6cac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.390+0000 7f6cc3400640 1 -- 172.21.15.142:0/2743194716 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f6cc408b8f0 con 0x7f6ccc0b0290 2024-04-01T15:23:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.390+0000 7f6ccaa00640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6cac06c8f0 0x7f6cac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.391+0000 7f6ccaa00640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6cac06c8f0 0x7f6cac06edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc001780 tx=0x7f6cbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.394+0000 7f6cc3400640 1 -- 172.21.15.142:0/2743194716 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6ccc0716f0 con 0x7f6ccc0b0290 2024-04-01T15:23:47.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.589+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ccc071b90 con 0x7f6cac06c8f0 2024-04-01T15:23:47.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.607+0000 7f6cc3400640 1 -- 172.21.15.142:0/2743194716 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251828 (secure 0 0 0) 0x7f6ccc071b90 con 0x7f6cac06c8f0 2024-04-01T15:23:47.611 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:23:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:23:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6cac06c8f0 msgr2=0x7f6cac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6cac06c8f0 0x7f6cac06edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc001780 tx=0x7f6cbc009040 comp rx=0 tx=0).stop 2024-04-01T15:23:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b0290 msgr2=0x7f6ccc1c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b0290 0x7f6ccc1c5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400e890 tx=0x7f6cc400ed50 comp rx=0 tx=0).stop 2024-04-01T15:23:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 shutdown_connections 2024-04-01T15:23:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f6cac06c8f0 0x7f6cac06edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b0290 0x7f6ccc1c5870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ccc0aefa0 0x7f6ccc09b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 --2- 172.21.15.142:0/2743194716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ccc06d8d0 0x7f6ccc1e0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 >> 172.21.15.142:0/2743194716 conn(0x7f6ccc0b5890 msgr2=0x7f6ccc1c8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 shutdown_connections 2024-04-01T15:23:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.612+0000 7f6cd1e00640 1 -- 172.21.15.142:0/2743194716 wait complete. 2024-04-01T15:23:47.629 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-01T15:23:46.600914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3088384,"data_stored":1850548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007742"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747701+0000","last_change":"2024-04-01T15:21:58.539004+0000","last_active":"2024-04-01T15:22:39.747701+0000","last_peered":"2024-04-01T15:22:39.747701+0000","last_clean":"2024-04-01T15:22:39.747701+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:22:39.747701+0000","last_undegraded":"2024-04-01T15:22:39.747701+0000","last_fullsized":"2024-04-01T15:22:39.747701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737668+0000","last_change":"2024-04-01T15:21:58.524238+0000","last_active":"2024-04-01T15:22:39.737668+0000","last_peered":"2024-04-01T15:22:39.737668+0000","last_clean":"2024-04-01T15:22:39.737668+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:22:39.737668+0000","last_undegraded":"2024-04-01T15:22:39.737668+0000","last_fullsized":"2024-04-01T15:22:39.737668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748607+0000","last_change":"2024-04-01T15:21:58.526226+0000","last_active":"2024-04-01T15:22:39.748607+0000","last_peered":"2024-04-01T15:22:39.748607+0000","last_clean":"2024-04-01T15:22:39.748607+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:22:39.748607+0000","last_undegraded":"2024-04-01T15:22:39.748607+0000","last_fullsized":"2024-04-01T15:22:39.748607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732299+0000","last_change":"2024-04-01T15:21:58.541297+0000","last_active":"2024-04-01T15:22:39.732299+0000","last_peered":"2024-04-01T15:22:39.732299+0000","last_clean":"2024-04-01T15:22:39.732299+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:22:39.732299+0000","last_undegraded":"2024-04-01T15:22:39.732299+0000","last_fullsized":"2024-04-01T15:22:39.732299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747043+0000","last_change":"2024-04-01T15:21:58.518814+0000","last_active":"2024-04-01T15:22:39.747043+0000","last_peered":"2024-04-01T15:22:39.747043+0000","last_clean":"2024-04-01T15:22:39.747043+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:22:39.747043+0000","last_undegraded":"2024-04-01T15:22:39.747043+0000","last_fullsized":"2024-04-01T15:22:39.747043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.755776+0000","last_change":"2024-04-01T15:22:39.753380+0000","last_active":"2024-04-01T15:22:39.755776+0000","last_peered":"2024-04-01T15:22:39.755776+0000","last_clean":"2024-04-01T15:22:39.755776+0000","last_became_active":"2024-04-01T15:22:39.752359+0000","last_became_peered":"2024-04-01T15:22:39.752359+0000","last_unstale":"2024-04-01T15:22:39.755776+0000","last_undegraded":"2024-04-01T15:22:39.755776+0000","last_fullsized":"2024-04-01T15:22:39.755776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747048+0000","last_change":"2024-04-01T15:21:58.522961+0000","last_active":"2024-04-01T15:22:39.747048+0000","last_peered":"2024-04-01T15:22:39.747048+0000","last_clean":"2024-04-01T15:22:39.747048+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:22:39.747048+0000","last_undegraded":"2024-04-01T15:22:39.747048+0000","last_fullsized":"2024-04-01T15:22:39.747048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:51:33.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751116+0000","last_change":"2024-04-01T15:21:58.530231+0000","last_active":"2024-04-01T15:22:39.751116+0000","last_peered":"2024-04-01T15:22:39.751116+0000","last_clean":"2024-04-01T15:22:39.751116+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:22:39.751116+0000","last_undegraded":"2024-04-01T15:22:39.751116+0000","last_fullsized":"2024-04-01T15:22:39.751116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747834+0000","last_change":"2024-04-01T15:21:58.526959+0000","last_active":"2024-04-01T15:22:39.747834+0000","last_peered":"2024-04-01T15:22:39.747834+0000","last_clean":"2024-04-01T15:22:39.747834+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:22:39.747834+0000","last_undegraded":"2024-04-01T15:22:39.747834+0000","last_fullsized":"2024-04-01T15:22:39.747834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.733705+0000","last_change":"2024-04-01T15:21:58.529489+0000","last_active":"2024-04-01T15:22:39.733705+0000","last_peered":"2024-04-01T15:22:39.733705+0000","last_clean":"2024-04-01T15:22:39.733705+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:22:39.733705+0000","last_undegraded":"2024-04-01T15:22:39.733705+0000","last_fullsized":"2024-04-01T15:22:39.733705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734352+0000","last_change":"2024-04-01T15:21:58.527803+0000","last_active":"2024-04-01T15:22:39.734352+0000","last_peered":"2024-04-01T15:22:39.734352+0000","last_clean":"2024-04-01T15:22:39.734352+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:22:39.734352+0000","last_undegraded":"2024-04-01T15:22:39.734352+0000","last_fullsized":"2024-04-01T15:22:39.734352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748645+0000","last_change":"2024-04-01T15:21:58.535848+0000","last_active":"2024-04-01T15:22:39.748645+0000","last_peered":"2024-04-01T15:22:39.748645+0000","last_clean":"2024-04-01T15:22:39.748645+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:22:39.748645+0000","last_undegraded":"2024-04-01T15:22:39.748645+0000","last_fullsized":"2024-04-01T15:22:39.748645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752869+0000","last_change":"2024-04-01T15:21:58.528912+0000","last_active":"2024-04-01T15:22:39.752869+0000","last_peered":"2024-04-01T15:22:39.752869+0000","last_clean":"2024-04-01T15:22:39.752869+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:22:39.752869+0000","last_undegraded":"2024-04-01T15:22:39.752869+0000","last_fullsized":"2024-04-01T15:22:39.752869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748368+0000","last_change":"2024-04-01T15:21:58.529847+0000","last_active":"2024-04-01T15:22:39.748368+0000","last_peered":"2024-04-01T15:22:39.748368+0000","last_clean":"2024-04-01T15:22:39.748368+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:22:39.748368+0000","last_undegraded":"2024-04-01T15:22:39.748368+0000","last_fullsized":"2024-04-01T15:22:39.748368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:44:07.006946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737739+0000","last_change":"2024-04-01T15:21:58.535414+0000","last_active":"2024-04-01T15:22:39.737739+0000","last_peered":"2024-04-01T15:22:39.737739+0000","last_clean":"2024-04-01T15:22:39.737739+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:22:39.737739+0000","last_undegraded":"2024-04-01T15:22:39.737739+0000","last_fullsized":"2024-04-01T15:22:39.737739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.730860+0000","last_change":"2024-04-01T15:21:58.522234+0000","last_active":"2024-04-01T15:22:39.730860+0000","last_peered":"2024-04-01T15:22:39.730860+0000","last_clean":"2024-04-01T15:22:39.730860+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:22:39.730860+0000","last_undegraded":"2024-04-01T15:22:39.730860+0000","last_fullsized":"2024-04-01T15:22:39.730860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732253+0000","last_change":"2024-04-01T15:21:58.531397+0000","last_active":"2024-04-01T15:22:39.732253+0000","last_peered":"2024-04-01T15:22:39.732253+0000","last_clean":"2024-04-01T15:22:39.732253+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:22:39.732253+0000","last_undegraded":"2024-04-01T15:22:39.732253+0000","last_fullsized":"2024-04-01T15:22:39.732253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728872+0000","last_change":"2024-04-01T15:21:58.522828+0000","last_active":"2024-04-01T15:22:39.728872+0000","last_peered":"2024-04-01T15:22:39.728872+0000","last_clean":"2024-04-01T15:22:39.728872+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:22:39.728872+0000","last_undegraded":"2024-04-01T15:22:39.728872+0000","last_fullsized":"2024-04-01T15:22:39.728872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747574+0000","last_change":"2024-04-01T15:21:58.532575+0000","last_active":"2024-04-01T15:22:39.747574+0000","last_peered":"2024-04-01T15:22:39.747574+0000","last_clean":"2024-04-01T15:22:39.747574+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:22:39.747574+0000","last_undegraded":"2024-04-01T15:22:39.747574+0000","last_fullsized":"2024-04-01T15:22:39.747574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731248+0000","last_change":"2024-04-01T15:21:58.530543+0000","last_active":"2024-04-01T15:22:39.731248+0000","last_peered":"2024-04-01T15:22:39.731248+0000","last_clean":"2024-04-01T15:22:39.731248+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:22:39.731248+0000","last_undegraded":"2024-04-01T15:22:39.731248+0000","last_fullsized":"2024-04-01T15:22:39.731248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748156+0000","last_change":"2024-04-01T15:21:58.528377+0000","last_active":"2024-04-01T15:22:39.748156+0000","last_peered":"2024-04-01T15:22:39.748156+0000","last_clean":"2024-04-01T15:22:39.748156+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:22:39.748156+0000","last_undegraded":"2024-04-01T15:22:39.748156+0000","last_fullsized":"2024-04-01T15:22:39.748156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:56:09.008728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731285+0000","last_change":"2024-04-01T15:21:58.530746+0000","last_active":"2024-04-01T15:22:39.731285+0000","last_peered":"2024-04-01T15:22:39.731285+0000","last_clean":"2024-04-01T15:22:39.731285+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:22:39.731285+0000","last_undegraded":"2024-04-01T15:22:39.731285+0000","last_fullsized":"2024-04-01T15:22:39.731285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749986+0000","last_change":"2024-04-01T15:21:58.516408+0000","last_active":"2024-04-01T15:22:39.749986+0000","last_peered":"2024-04-01T15:22:39.749986+0000","last_clean":"2024-04-01T15:22:39.749986+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:22:39.749986+0000","last_undegraded":"2024-04-01T15:22:39.749986+0000","last_fullsized":"2024-04-01T15:22:39.749986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731046+0000","last_change":"2024-04-01T15:21:58.525868+0000","last_active":"2024-04-01T15:22:39.731046+0000","last_peered":"2024-04-01T15:22:39.731046+0000","last_clean":"2024-04-01T15:22:39.731046+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:22:39.731046+0000","last_undegraded":"2024-04-01T15:22:39.731046+0000","last_fullsized":"2024-04-01T15:22:39.731046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754513+0000","last_change":"2024-04-01T15:21:58.531952+0000","last_active":"2024-04-01T15:22:39.754513+0000","last_peered":"2024-04-01T15:22:39.754513+0000","last_clean":"2024-04-01T15:22:39.754513+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:22:39.754513+0000","last_undegraded":"2024-04-01T15:22:39.754513+0000","last_fullsized":"2024-04-01T15:22:39.754513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.733953+0000","last_change":"2024-04-01T15:21:58.517341+0000","last_active":"2024-04-01T15:22:39.733953+0000","last_peered":"2024-04-01T15:22:39.733953+0000","last_clean":"2024-04-01T15:22:39.733953+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:22:39.733953+0000","last_undegraded":"2024-04-01T15:22:39.733953+0000","last_fullsized":"2024-04-01T15:22:39.733953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737920+0000","last_change":"2024-04-01T15:21:58.535087+0000","last_active":"2024-04-01T15:22:39.737920+0000","last_peered":"2024-04-01T15:22:39.737920+0000","last_clean":"2024-04-01T15:22:39.737920+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:22:39.737920+0000","last_undegraded":"2024-04-01T15:22:39.737920+0000","last_fullsized":"2024-04-01T15:22:39.737920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752727+0000","last_change":"2024-04-01T15:21:58.531487+0000","last_active":"2024-04-01T15:22:39.752727+0000","last_peered":"2024-04-01T15:22:39.752727+0000","last_clean":"2024-04-01T15:22:39.752727+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:22:39.752727+0000","last_undegraded":"2024-04-01T15:22:39.752727+0000","last_fullsized":"2024-04-01T15:22:39.752727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748164+0000","last_change":"2024-04-01T15:21:58.531305+0000","last_active":"2024-04-01T15:22:39.748164+0000","last_peered":"2024-04-01T15:22:39.748164+0000","last_clean":"2024-04-01T15:22:39.748164+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:22:39.748164+0000","last_undegraded":"2024-04-01T15:22:39.748164+0000","last_fullsized":"2024-04-01T15:22:39.748164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731539+0000","last_change":"2024-04-01T15:21:58.530998+0000","last_active":"2024-04-01T15:22:39.731539+0000","last_peered":"2024-04-01T15:22:39.731539+0000","last_clean":"2024-04-01T15:22:39.731539+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:22:39.731539+0000","last_undegraded":"2024-04-01T15:22:39.731539+0000","last_fullsized":"2024-04-01T15:22:39.731539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728576+0000","last_change":"2024-04-01T15:21:58.523119+0000","last_active":"2024-04-01T15:22:39.728576+0000","last_peered":"2024-04-01T15:22:39.728576+0000","last_clean":"2024-04-01T15:22:39.728576+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:22:39.728576+0000","last_undegraded":"2024-04-01T15:22:39.728576+0000","last_fullsized":"2024-04-01T15:22:39.728576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.730767+0000","last_change":"2024-04-01T15:21:58.514302+0000","last_active":"2024-04-01T15:22:39.730767+0000","last_peered":"2024-04-01T15:22:39.730767+0000","last_clean":"2024-04-01T15:22:39.730767+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:22:39.730767+0000","last_undegraded":"2024-04-01T15:22:39.730767+0000","last_fullsized":"2024-04-01T15:22:39.730767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748155+0000","last_change":"2024-04-01T15:21:58.528525+0000","last_active":"2024-04-01T15:22:39.748155+0000","last_peered":"2024-04-01T15:22:39.748155+0000","last_clean":"2024-04-01T15:22:39.748155+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:22:39.748155+0000","last_undegraded":"2024-04-01T15:22:39.748155+0000","last_fullsized":"2024-04-01T15:22:39.748155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:58.054203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.753403+0000","last_change":"2024-04-01T15:21:57.523557+0000","last_active":"2024-04-01T15:22:39.753403+0000","last_peered":"2024-04-01T15:22:39.753403+0000","last_clean":"2024-04-01T15:22:39.753403+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:22:39.753403+0000","last_undegraded":"2024-04-01T15:22:39.753403+0000","last_fullsized":"2024-04-01T15:22:39.753403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748537+0000","last_change":"2024-04-01T15:21:58.531570+0000","last_active":"2024-04-01T15:22:39.748537+0000","last_peered":"2024-04-01T15:22:39.748537+0000","last_clean":"2024-04-01T15:22:39.748537+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:22:39.748537+0000","last_undegraded":"2024-04-01T15:22:39.748537+0000","last_fullsized":"2024-04-01T15:22:39.748537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732276+0000","last_change":"2024-04-01T15:21:57.519248+0000","last_active":"2024-04-01T15:22:39.732276+0000","last_peered":"2024-04-01T15:22:39.732276+0000","last_clean":"2024-04-01T15:22:39.732276+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:22:39.732276+0000","last_undegraded":"2024-04-01T15:22:39.732276+0000","last_fullsized":"2024-04-01T15:22:39.732276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751667+0000","last_change":"2024-04-01T15:21:57.518727+0000","last_active":"2024-04-01T15:22:39.751667+0000","last_peered":"2024-04-01T15:22:39.751667+0000","last_clean":"2024-04-01T15:22:39.751667+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:22:39.751667+0000","last_undegraded":"2024-04-01T15:22:39.751667+0000","last_fullsized":"2024-04-01T15:22:39.751667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:15:36.993209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752004+0000","last_change":"2024-04-01T15:21:58.527894+0000","last_active":"2024-04-01T15:22:39.752004+0000","last_peered":"2024-04-01T15:22:39.752004+0000","last_clean":"2024-04-01T15:22:39.752004+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:22:39.752004+0000","last_undegraded":"2024-04-01T15:22:39.752004+0000","last_fullsized":"2024-04-01T15:22:39.752004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731247+0000","last_change":"2024-04-01T15:21:57.534982+0000","last_active":"2024-04-01T15:22:39.731247+0000","last_peered":"2024-04-01T15:22:39.731247+0000","last_clean":"2024-04-01T15:22:39.731247+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:22:39.731247+0000","last_undegraded":"2024-04-01T15:22:39.731247+0000","last_fullsized":"2024-04-01T15:22:39.731247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737161+0000","last_change":"2024-04-01T15:21:58.525017+0000","last_active":"2024-04-01T15:22:39.737161+0000","last_peered":"2024-04-01T15:22:39.737161+0000","last_clean":"2024-04-01T15:22:39.737161+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:22:39.737161+0000","last_undegraded":"2024-04-01T15:22:39.737161+0000","last_fullsized":"2024-04-01T15:22:39.737161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734537+0000","last_change":"2024-04-01T15:21:57.528840+0000","last_active":"2024-04-01T15:22:39.734537+0000","last_peered":"2024-04-01T15:22:39.734537+0000","last_clean":"2024-04-01T15:22:39.734537+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:22:39.734537+0000","last_undegraded":"2024-04-01T15:22:39.734537+0000","last_fullsized":"2024-04-01T15:22:39.734537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732656+0000","last_change":"2024-04-01T15:21:58.529422+0000","last_active":"2024-04-01T15:22:39.732656+0000","last_peered":"2024-04-01T15:22:39.732656+0000","last_clean":"2024-04-01T15:22:39.732656+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:22:39.732656+0000","last_undegraded":"2024-04-01T15:22:39.732656+0000","last_fullsized":"2024-04-01T15:22:39.732656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732852+0000","last_change":"2024-04-01T15:21:57.528345+0000","last_active":"2024-04-01T15:22:39.732852+0000","last_peered":"2024-04-01T15:22:39.732852+0000","last_clean":"2024-04-01T15:22:39.732852+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:22:39.732852+0000","last_undegraded":"2024-04-01T15:22:39.732852+0000","last_fullsized":"2024-04-01T15:22:39.732852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749777+0000","last_change":"2024-04-01T15:21:58.529376+0000","last_active":"2024-04-01T15:22:39.749777+0000","last_peered":"2024-04-01T15:22:39.749777+0000","last_clean":"2024-04-01T15:22:39.749777+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:22:39.749777+0000","last_undegraded":"2024-04-01T15:22:39.749777+0000","last_fullsized":"2024-04-01T15:22:39.749777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738000+0000","last_change":"2024-04-01T15:21:57.526610+0000","last_active":"2024-04-01T15:22:39.738000+0000","last_peered":"2024-04-01T15:22:39.738000+0000","last_clean":"2024-04-01T15:22:39.738000+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:22:39.738000+0000","last_undegraded":"2024-04-01T15:22:39.738000+0000","last_fullsized":"2024-04-01T15:22:39.738000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748837+0000","last_change":"2024-04-01T15:21:58.537476+0000","last_active":"2024-04-01T15:22:39.748837+0000","last_peered":"2024-04-01T15:22:39.748837+0000","last_clean":"2024-04-01T15:22:39.748837+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:22:39.748837+0000","last_undegraded":"2024-04-01T15:22:39.748837+0000","last_fullsized":"2024-04-01T15:22:39.748837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731532+0000","last_change":"2024-04-01T15:21:57.513766+0000","last_active":"2024-04-01T15:22:39.731532+0000","last_peered":"2024-04-01T15:22:39.731532+0000","last_clean":"2024-04-01T15:22:39.731532+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:22:39.731532+0000","last_undegraded":"2024-04-01T15:22:39.731532+0000","last_fullsized":"2024-04-01T15:22:39.731532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747415+0000","last_change":"2024-04-01T15:21:58.539751+0000","last_active":"2024-04-01T15:22:39.747415+0000","last_peered":"2024-04-01T15:22:39.747415+0000","last_clean":"2024-04-01T15:22:39.747415+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:22:39.747415+0000","last_undegraded":"2024-04-01T15:22:39.747415+0000","last_fullsized":"2024-04-01T15:22:39.747415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748814+0000","last_change":"2024-04-01T15:21:57.520158+0000","last_active":"2024-04-01T15:22:39.748814+0000","last_peered":"2024-04-01T15:22:39.748814+0000","last_clean":"2024-04-01T15:22:39.748814+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:22:39.748814+0000","last_undegraded":"2024-04-01T15:22:39.748814+0000","last_fullsized":"2024-04-01T15:22:39.748814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748643+0000","last_change":"2024-04-01T15:21:58.532249+0000","last_active":"2024-04-01T15:22:39.748643+0000","last_peered":"2024-04-01T15:22:39.748643+0000","last_clean":"2024-04-01T15:22:39.748643+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:22:39.748643+0000","last_undegraded":"2024-04-01T15:22:39.748643+0000","last_fullsized":"2024-04-01T15:22:39.748643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.229948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731604+0000","last_change":"2024-04-01T15:21:57.528780+0000","last_active":"2024-04-01T15:22:39.731604+0000","last_peered":"2024-04-01T15:22:39.731604+0000","last_clean":"2024-04-01T15:22:39.731604+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:22:39.731604+0000","last_undegraded":"2024-04-01T15:22:39.731604+0000","last_fullsized":"2024-04-01T15:22:39.731604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747190+0000","last_change":"2024-04-01T15:21:58.528458+0000","last_active":"2024-04-01T15:22:39.747190+0000","last_peered":"2024-04-01T15:22:39.747190+0000","last_clean":"2024-04-01T15:22:39.747190+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:22:39.747190+0000","last_undegraded":"2024-04-01T15:22:39.747190+0000","last_fullsized":"2024-04-01T15:22:39.747190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731732+0000","last_change":"2024-04-01T15:21:57.528026+0000","last_active":"2024-04-01T15:22:39.731732+0000","last_peered":"2024-04-01T15:22:39.731732+0000","last_clean":"2024-04-01T15:22:39.731732+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:22:39.731732+0000","last_undegraded":"2024-04-01T15:22:39.731732+0000","last_fullsized":"2024-04-01T15:22:39.731732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731062+0000","last_change":"2024-04-01T15:21:58.514047+0000","last_active":"2024-04-01T15:22:39.731062+0000","last_peered":"2024-04-01T15:22:39.731062+0000","last_clean":"2024-04-01T15:22:39.731062+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:22:39.731062+0000","last_undegraded":"2024-04-01T15:22:39.731062+0000","last_fullsized":"2024-04-01T15:22:39.731062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728412+0000","last_change":"2024-04-01T15:21:57.517184+0000","last_active":"2024-04-01T15:22:39.728412+0000","last_peered":"2024-04-01T15:22:39.728412+0000","last_clean":"2024-04-01T15:22:39.728412+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:22:39.728412+0000","last_undegraded":"2024-04-01T15:22:39.728412+0000","last_fullsized":"2024-04-01T15:22:39.728412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746976+0000","last_change":"2024-04-01T15:21:58.529946+0000","last_active":"2024-04-01T15:22:39.746976+0000","last_peered":"2024-04-01T15:22:39.746976+0000","last_clean":"2024-04-01T15:22:39.746976+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:22:39.746976+0000","last_undegraded":"2024-04-01T15:22:39.746976+0000","last_fullsized":"2024-04-01T15:22:39.746976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748524+0000","last_change":"2024-04-01T15:21:57.519642+0000","last_active":"2024-04-01T15:22:39.748524+0000","last_peered":"2024-04-01T15:22:39.748524+0000","last_clean":"2024-04-01T15:22:39.748524+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:22:39.748524+0000","last_undegraded":"2024-04-01T15:22:39.748524+0000","last_fullsized":"2024-04-01T15:22:39.748524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:09:07.894019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747731+0000","last_change":"2024-04-01T15:21:58.529121+0000","last_active":"2024-04-01T15:22:39.747731+0000","last_peered":"2024-04-01T15:22:39.747731+0000","last_clean":"2024-04-01T15:22:39.747731+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:22:39.747731+0000","last_undegraded":"2024-04-01T15:22:39.747731+0000","last_fullsized":"2024-04-01T15:22:39.747731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.729158+0000","last_change":"2024-04-01T15:21:57.514455+0000","last_active":"2024-04-01T15:22:39.729158+0000","last_peered":"2024-04-01T15:22:39.729158+0000","last_clean":"2024-04-01T15:22:39.729158+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:22:39.729158+0000","last_undegraded":"2024-04-01T15:22:39.729158+0000","last_fullsized":"2024-04-01T15:22:39.729158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747837+0000","last_change":"2024-04-01T15:21:58.535610+0000","last_active":"2024-04-01T15:22:39.747837+0000","last_peered":"2024-04-01T15:22:39.747837+0000","last_clean":"2024-04-01T15:22:39.747837+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:22:39.747837+0000","last_undegraded":"2024-04-01T15:22:39.747837+0000","last_fullsized":"2024-04-01T15:22:39.747837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738118+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:22:39.738118+0000","last_peered":"2024-04-01T15:22:39.738118+0000","last_clean":"2024-04-01T15:22:39.738118+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:22:39.738118+0000","last_undegraded":"2024-04-01T15:22:39.738118+0000","last_fullsized":"2024-04-01T15:22:39.738118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.740524+0000","last_change":"2024-04-01T15:22:39.740524+0000","last_active":"2024-04-01T15:22:39.740524+0000","last_peered":"2024-04-01T15:22:39.740524+0000","last_clean":"2024-04-01T15:22:39.740524+0000","last_became_active":"2024-04-01T15:22:39.739729+0000","last_became_peered":"2024-04-01T15:22:39.739729+0000","last_unstale":"2024-04-01T15:22:39.740524+0000","last_undegraded":"2024-04-01T15:22:39.740524+0000","last_fullsized":"2024-04-01T15:22:39.740524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:42.451490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.729348+0000","last_change":"2024-04-01T15:21:57.532167+0000","last_active":"2024-04-01T15:22:39.729348+0000","last_peered":"2024-04-01T15:22:39.729348+0000","last_clean":"2024-04-01T15:22:39.729348+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:22:39.729348+0000","last_undegraded":"2024-04-01T15:22:39.729348+0000","last_fullsized":"2024-04-01T15:22:39.729348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.745212+0000","last_change":"2024-04-01T15:22:39.741396+0000","last_active":"2024-04-01T15:22:39.745212+0000","last_peered":"2024-04-01T15:22:39.745212+0000","last_clean":"2024-04-01T15:22:39.745212+0000","last_became_active":"2024-04-01T15:22:39.740443+0000","last_became_peered":"2024-04-01T15:22:39.740443+0000","last_unstale":"2024-04-01T15:22:39.745212+0000","last_undegraded":"2024-04-01T15:22:39.745212+0000","last_fullsized":"2024-04-01T15:22:39.745212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:25:59.110797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746901+0000","last_change":"2024-04-01T15:21:47.878530+0000","last_active":"2024-04-01T15:22:39.746901+0000","last_peered":"2024-04-01T15:22:39.746901+0000","last_clean":"2024-04-01T15:22:39.746901+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:22:39.746901+0000","last_undegraded":"2024-04-01T15:22:39.746901+0000","last_fullsized":"2024-04-01T15:22:39.746901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_clean_scrub_stamp":"2024-04-01T15:21:46.852307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:25:18.137507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731374+0000","last_change":"2024-04-01T15:21:57.530394+0000","last_active":"2024-04-01T15:22:39.731374+0000","last_peered":"2024-04-01T15:22:39.731374+0000","last_clean":"2024-04-01T15:22:39.731374+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:22:39.731374+0000","last_undegraded":"2024-04-01T15:22:39.731374+0000","last_fullsized":"2024-04-01T15:22:39.731374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752344+0000","last_change":"2024-04-01T15:21:58.529751+0000","last_active":"2024-04-01T15:22:39.752344+0000","last_peered":"2024-04-01T15:22:39.752344+0000","last_clean":"2024-04-01T15:22:39.752344+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:22:39.752344+0000","last_undegraded":"2024-04-01T15:22:39.752344+0000","last_fullsized":"2024-04-01T15:22:39.752344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746918+0000","last_change":"2024-04-01T15:21:57.526919+0000","last_active":"2024-04-01T15:22:39.746918+0000","last_peered":"2024-04-01T15:22:39.746918+0000","last_clean":"2024-04-01T15:22:39.746918+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:22:39.746918+0000","last_undegraded":"2024-04-01T15:22:39.746918+0000","last_fullsized":"2024-04-01T15:22:39.746918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747676+0000","last_change":"2024-04-01T15:21:58.525329+0000","last_active":"2024-04-01T15:22:39.747676+0000","last_peered":"2024-04-01T15:22:39.747676+0000","last_clean":"2024-04-01T15:22:39.747676+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:22:39.747676+0000","last_undegraded":"2024-04-01T15:22:39.747676+0000","last_fullsized":"2024-04-01T15:22:39.747676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728881+0000","last_change":"2024-04-01T15:21:57.511176+0000","last_active":"2024-04-01T15:22:39.728881+0000","last_peered":"2024-04-01T15:22:39.728881+0000","last_clean":"2024-04-01T15:22:39.728881+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:22:39.728881+0000","last_undegraded":"2024-04-01T15:22:39.728881+0000","last_fullsized":"2024-04-01T15:22:39.728881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737037+0000","last_change":"2024-04-01T15:21:58.523794+0000","last_active":"2024-04-01T15:22:39.737037+0000","last_peered":"2024-04-01T15:22:39.737037+0000","last_clean":"2024-04-01T15:22:39.737037+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:22:39.737037+0000","last_undegraded":"2024-04-01T15:22:39.737037+0000","last_fullsized":"2024-04-01T15:22:39.737037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731803+0000","last_change":"2024-04-01T15:21:57.527763+0000","last_active":"2024-04-01T15:22:39.731803+0000","last_peered":"2024-04-01T15:22:39.731803+0000","last_clean":"2024-04-01T15:22:39.731803+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:22:39.731803+0000","last_undegraded":"2024-04-01T15:22:39.731803+0000","last_fullsized":"2024-04-01T15:22:39.731803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748426+0000","last_change":"2024-04-01T15:21:58.531026+0000","last_active":"2024-04-01T15:22:39.748426+0000","last_peered":"2024-04-01T15:22:39.748426+0000","last_clean":"2024-04-01T15:22:39.748426+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:22:39.748426+0000","last_undegraded":"2024-04-01T15:22:39.748426+0000","last_fullsized":"2024-04-01T15:22:39.748426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:50.706762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737539+0000","last_change":"2024-04-01T15:21:57.517159+0000","last_active":"2024-04-01T15:22:39.737539+0000","last_peered":"2024-04-01T15:22:39.737539+0000","last_clean":"2024-04-01T15:22:39.737539+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:22:39.737539+0000","last_undegraded":"2024-04-01T15:22:39.737539+0000","last_fullsized":"2024-04-01T15:22:39.737539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732520+0000","last_change":"2024-04-01T15:21:58.541348+0000","last_active":"2024-04-01T15:22:39.732520+0000","last_peered":"2024-04-01T15:22:39.732520+0000","last_clean":"2024-04-01T15:22:39.732520+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:22:39.732520+0000","last_undegraded":"2024-04-01T15:22:39.732520+0000","last_fullsized":"2024-04-01T15:22:39.732520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747695+0000","last_change":"2024-04-01T15:21:57.526914+0000","last_active":"2024-04-01T15:22:39.747695+0000","last_peered":"2024-04-01T15:22:39.747695+0000","last_clean":"2024-04-01T15:22:39.747695+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:22:39.747695+0000","last_undegraded":"2024-04-01T15:22:39.747695+0000","last_fullsized":"2024-04-01T15:22:39.747695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737407+0000","last_change":"2024-04-01T15:21:58.515834+0000","last_active":"2024-04-01T15:22:39.737407+0000","last_peered":"2024-04-01T15:22:39.737407+0000","last_clean":"2024-04-01T15:22:39.737407+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:22:39.737407+0000","last_undegraded":"2024-04-01T15:22:39.737407+0000","last_fullsized":"2024-04-01T15:22:39.737407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738464+0000","last_change":"2024-04-01T15:21:57.533452+0000","last_active":"2024-04-01T15:22:39.738464+0000","last_peered":"2024-04-01T15:22:39.738464+0000","last_clean":"2024-04-01T15:22:39.738464+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:22:39.738464+0000","last_undegraded":"2024-04-01T15:22:39.738464+0000","last_fullsized":"2024-04-01T15:22:39.738464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754786+0000","last_change":"2024-04-01T15:21:58.512191+0000","last_active":"2024-04-01T15:22:39.754786+0000","last_peered":"2024-04-01T15:22:39.754786+0000","last_clean":"2024-04-01T15:22:39.754786+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:22:39.754786+0000","last_undegraded":"2024-04-01T15:22:39.754786+0000","last_fullsized":"2024-04-01T15:22:39.754786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734713+0000","last_change":"2024-04-01T15:21:57.526196+0000","last_active":"2024-04-01T15:22:39.734713+0000","last_peered":"2024-04-01T15:22:39.734713+0000","last_clean":"2024-04-01T15:22:39.734713+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:22:39.734713+0000","last_undegraded":"2024-04-01T15:22:39.734713+0000","last_fullsized":"2024-04-01T15:22:39.734713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749441+0000","last_change":"2024-04-01T15:21:58.526739+0000","last_active":"2024-04-01T15:22:39.749441+0000","last_peered":"2024-04-01T15:22:39.749441+0000","last_clean":"2024-04-01T15:22:39.749441+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:22:39.749441+0000","last_undegraded":"2024-04-01T15:22:39.749441+0000","last_fullsized":"2024-04-01T15:22:39.749441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746750+0000","last_change":"2024-04-01T15:21:57.526924+0000","last_active":"2024-04-01T15:22:39.746750+0000","last_peered":"2024-04-01T15:22:39.746750+0000","last_clean":"2024-04-01T15:22:39.746750+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:22:39.746750+0000","last_undegraded":"2024-04-01T15:22:39.746750+0000","last_fullsized":"2024-04-01T15:22:39.746750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749243+0000","last_change":"2024-04-01T15:21:58.528396+0000","last_active":"2024-04-01T15:22:39.749243+0000","last_peered":"2024-04-01T15:22:39.749243+0000","last_clean":"2024-04-01T15:22:39.749243+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:22:39.749243+0000","last_undegraded":"2024-04-01T15:22:39.749243+0000","last_fullsized":"2024-04-01T15:22:39.749243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:50.943225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737525+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:22:39.737525+0000","last_peered":"2024-04-01T15:22:39.737525+0000","last_clean":"2024-04-01T15:22:39.737525+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:22:39.737525+0000","last_undegraded":"2024-04-01T15:22:39.737525+0000","last_fullsized":"2024-04-01T15:22:39.737525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:09.572891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751390+0000","last_change":"2024-04-01T15:21:58.529955+0000","last_active":"2024-04-01T15:22:39.751390+0000","last_peered":"2024-04-01T15:22:39.751390+0000","last_clean":"2024-04-01T15:22:39.751390+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:22:39.751390+0000","last_undegraded":"2024-04-01T15:22:39.751390+0000","last_fullsized":"2024-04-01T15:22:39.751390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737822+0000","last_change":"2024-04-01T15:21:57.526620+0000","last_active":"2024-04-01T15:22:39.737822+0000","last_peered":"2024-04-01T15:22:39.737822+0000","last_clean":"2024-04-01T15:22:39.737822+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:22:39.737822+0000","last_undegraded":"2024-04-01T15:22:39.737822+0000","last_fullsized":"2024-04-01T15:22:39.737822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.753152+0000","last_change":"2024-04-01T15:21:58.534484+0000","last_active":"2024-04-01T15:22:39.753152+0000","last_peered":"2024-04-01T15:22:39.753152+0000","last_clean":"2024-04-01T15:22:39.753152+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:22:39.753152+0000","last_undegraded":"2024-04-01T15:22:39.753152+0000","last_fullsized":"2024-04-01T15:22:39.753152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747363+0000","last_change":"2024-04-01T15:21:57.531639+0000","last_active":"2024-04-01T15:22:39.747363+0000","last_peered":"2024-04-01T15:22:39.747363+0000","last_clean":"2024-04-01T15:22:39.747363+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:22:39.747363+0000","last_undegraded":"2024-04-01T15:22:39.747363+0000","last_fullsized":"2024-04-01T15:22:39.747363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732012+0000","last_change":"2024-04-01T15:21:58.523366+0000","last_active":"2024-04-01T15:22:39.732012+0000","last_peered":"2024-04-01T15:22:39.732012+0000","last_clean":"2024-04-01T15:22:39.732012+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:22:39.732012+0000","last_undegraded":"2024-04-01T15:22:39.732012+0000","last_fullsized":"2024-04-01T15:22:39.732012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732440+0000","last_change":"2024-04-01T15:21:58.526457+0000","last_active":"2024-04-01T15:22:39.732440+0000","last_peered":"2024-04-01T15:22:39.732440+0000","last_clean":"2024-04-01T15:22:39.732440+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:22:39.732440+0000","last_undegraded":"2024-04-01T15:22:39.732440+0000","last_fullsized":"2024-04-01T15:22:39.732440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747278+0000","last_change":"2024-04-01T15:21:57.534510+0000","last_active":"2024-04-01T15:22:39.747278+0000","last_peered":"2024-04-01T15:22:39.747278+0000","last_clean":"2024-04-01T15:22:39.747278+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:22:39.747278+0000","last_undegraded":"2024-04-01T15:22:39.747278+0000","last_fullsized":"2024-04-01T15:22:39.747278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754630+0000","last_change":"2024-04-01T15:22:39.750841+0000","last_active":"2024-04-01T15:22:39.754630+0000","last_peered":"2024-04-01T15:22:39.754630+0000","last_clean":"2024-04-01T15:22:39.754630+0000","last_became_active":"2024-04-01T15:22:39.750255+0000","last_became_peered":"2024-04-01T15:22:39.750255+0000","last_unstale":"2024-04-01T15:22:39.754630+0000","last_undegraded":"2024-04-01T15:22:39.754630+0000","last_fullsized":"2024-04-01T15:22:39.754630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747532+0000","last_change":"2024-04-01T15:21:57.533797+0000","last_active":"2024-04-01T15:22:39.747532+0000","last_peered":"2024-04-01T15:22:39.747532+0000","last_clean":"2024-04-01T15:22:39.747532+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:22:39.747532+0000","last_undegraded":"2024-04-01T15:22:39.747532+0000","last_fullsized":"2024-04-01T15:22:39.747532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:16:16.205030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749155+0000","last_change":"2024-04-01T15:21:58.524922+0000","last_active":"2024-04-01T15:22:39.749155+0000","last_peered":"2024-04-01T15:22:39.749155+0000","last_clean":"2024-04-01T15:22:39.749155+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:22:39.749155+0000","last_undegraded":"2024-04-01T15:22:39.749155+0000","last_fullsized":"2024-04-01T15:22:39.749155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754618+0000","last_change":"2024-04-01T15:21:57.518934+0000","last_active":"2024-04-01T15:22:39.754618+0000","last_peered":"2024-04-01T15:22:39.754618+0000","last_clean":"2024-04-01T15:22:39.754618+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:22:39.754618+0000","last_undegraded":"2024-04-01T15:22:39.754618+0000","last_fullsized":"2024-04-01T15:22:39.754618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754328+0000","last_change":"2024-04-01T15:21:58.538259+0000","last_active":"2024-04-01T15:22:39.754328+0000","last_peered":"2024-04-01T15:22:39.754328+0000","last_clean":"2024-04-01T15:22:39.754328+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:22:39.754328+0000","last_undegraded":"2024-04-01T15:22:39.754328+0000","last_fullsized":"2024-04-01T15:22:39.754328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749835+0000","last_change":"2024-04-01T15:21:57.524507+0000","last_active":"2024-04-01T15:22:39.749835+0000","last_peered":"2024-04-01T15:22:39.749835+0000","last_clean":"2024-04-01T15:22:39.749835+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:22:39.749835+0000","last_undegraded":"2024-04-01T15:22:39.749835+0000","last_fullsized":"2024-04-01T15:22:39.749835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:29:44.659776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":674074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":84736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":83214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":83250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":84736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":83124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":83284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":674130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:23:47.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:23:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.881+0000 7f8806400640 1 Processor -- start 2024-04-01T15:23:47.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.881+0000 7f8806400640 1 -- start start 2024-04-01T15:23:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.882+0000 7f8806400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880006d8d0 0x7f88000b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.882+0000 7f8806400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88000b0fb0 0x7f88001491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.882+0000 7f8806400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8800149720 0x7f88000b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.882+0000 7f8806400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f88000b0b20 con 0x7f88000b0fb0 2024-04-01T15:23:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.882+0000 7f8806400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f880006dcb0 con 0x7f8800149720 2024-04-01T15:23:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.882+0000 7f8806400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8800148ad0 con 0x7f880006d8d0 2024-04-01T15:23:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.882+0000 7f87fea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88000b0fb0 0x7f88001491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.883+0000 7f87fea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88000b0fb0 0x7f88001491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37782/0 (socket says 172.21.15.142:37782) 2024-04-01T15:23:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.883+0000 7f87fea00640 1 -- 172.21.15.142:0/1040758172 learned_addr learned my addr 172.21.15.142:0/1040758172 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.883+0000 7f87ffe00640 1 --2- 172.21.15.142:0/1040758172 >> v2:172.21.15.179:3300/0 conn(0x7f8800149720 0x7f88000b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.883+0000 7f87ff400640 1 --2- 172.21.15.142:0/1040758172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880006d8d0 0x7f88000b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.883+0000 7f87fea00640 1 -- 172.21.15.142:0/1040758172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880006d8d0 msgr2=0x7f88000b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.883+0000 7f87fea00640 1 --2- 172.21.15.142:0/1040758172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880006d8d0 0x7f88000b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.883+0000 7f87fea00640 1 -- 172.21.15.142:0/1040758172 >> v2:172.21.15.179:3300/0 conn(0x7f8800149720 msgr2=0x7f88000b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.883+0000 7f87fea00640 1 --2- 172.21.15.142:0/1040758172 >> v2:172.21.15.179:3300/0 conn(0x7f8800149720 0x7f88000b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.883+0000 7f87fea00640 1 -- 172.21.15.142:0/1040758172 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88000b5230 con 0x7f88000b0fb0 2024-04-01T15:23:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.884+0000 7f87fea00640 1 --2- 172.21.15.142:0/1040758172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88000b0fb0 0x7f88001491e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f88000b4ba0 tx=0x7f87f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d52c50334bfd85f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.884+0000 7f87fe000640 1 -- 172.21.15.142:0/1040758172 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0035020 con 0x7f88000b0fb0 2024-04-01T15:23:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.884+0000 7f87fe000640 1 -- 172.21.15.142:0/1040758172 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f0031870 con 0x7f88000b0fb0 2024-04-01T15:23:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.884+0000 7f87fe000640 1 -- 172.21.15.142:0/1040758172 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0031c40 con 0x7f88000b0fb0 2024-04-01T15:23:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.885+0000 7f8806400640 1 -- 172.21.15.142:0/1040758172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88000b0fb0 msgr2=0x7f88001491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.885+0000 7f8806400640 1 --2- 172.21.15.142:0/1040758172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88000b0fb0 0x7f88001491e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f88000b4ba0 tx=0x7f87f002b910 comp rx=0 tx=0).stop 2024-04-01T15:23:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.885+0000 7f8806400640 1 -- 172.21.15.142:0/1040758172 shutdown_connections 2024-04-01T15:23:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.885+0000 7f8806400640 1 --2- 172.21.15.142:0/1040758172 >> v2:172.21.15.179:3300/0 conn(0x7f8800149720 0x7f88000b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.885+0000 7f8806400640 1 --2- 172.21.15.142:0/1040758172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88000b0fb0 0x7f88001491e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.885+0000 7f8806400640 1 --2- 172.21.15.142:0/1040758172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880006d8d0 0x7f88000b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.885+0000 7f8806400640 1 -- 172.21.15.142:0/1040758172 >> 172.21.15.142:0/1040758172 conn(0x7f88000b5890 msgr2=0x7f88000b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.885+0000 7f8806400640 1 -- 172.21.15.142:0/1040758172 shutdown_connections 2024-04-01T15:23:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.885+0000 7f8806400640 1 -- 172.21.15.142:0/1040758172 wait complete. 2024-04-01T15:23:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.887+0000 7f8806400640 1 Processor -- start 2024-04-01T15:23:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.887+0000 7f8806400640 1 -- start start 2024-04-01T15:23:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f8806400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f880006d8d0 0x7f88001ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f8806400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b0fb0 0x7f8800146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f8806400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8800149720 0x7f8800147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f8806400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f88000b4fd0 con 0x7f880006d8d0 2024-04-01T15:23:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f8806400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f88000b4e50 con 0x7f8800149720 2024-04-01T15:23:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f8806400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f880009edc0 con 0x7f88000b0fb0 2024-04-01T15:23:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87ff400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f880006d8d0 0x7f88001ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87ff400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f880006d8d0 0x7f88001ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37784/0 (socket says 172.21.15.142:37784) 2024-04-01T15:23:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87ff400640 1 -- 172.21.15.142:0/2845674805 learned_addr learned my addr 172.21.15.142:0/2845674805 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87fea00640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b0fb0 0x7f8800146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87ffe00640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8800149720 0x7f8800147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87ff400640 1 -- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b0fb0 msgr2=0x7f8800146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87ff400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b0fb0 0x7f8800146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87ff400640 1 -- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8800149720 msgr2=0x7f8800147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87ff400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8800149720 0x7f8800147200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.888+0000 7f87ff400640 1 -- 172.21.15.142:0/2845674805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88001d1770 con 0x7f880006d8d0 2024-04-01T15:23:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.889+0000 7f87ff400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f880006d8d0 0x7f88001ceb60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f87e800d800 tx=0x7f87e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.889+0000 7f87f7400640 1 -- 172.21.15.142:0/2845674805 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e800b660 con 0x7f880006d8d0 2024-04-01T15:23:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.889+0000 7f87f7400640 1 -- 172.21.15.142:0/2845674805 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e8019070 con 0x7f880006d8d0 2024-04-01T15:23:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.889+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88001cfdc0 con 0x7f880006d8d0 2024-04-01T15:23:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.889+0000 7f87f7400640 1 -- 172.21.15.142:0/2845674805 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e800ba20 con 0x7f880006d8d0 2024-04-01T15:23:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.889+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88000af890 con 0x7f880006d8d0 2024-04-01T15:23:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.890+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8800068710 con 0x7f880006d8d0 2024-04-01T15:23:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.891+0000 7f87f7400640 1 -- 172.21.15.142:0/2845674805 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87e800bbc0 con 0x7f880006d8d0 2024-04-01T15:23:47.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.892+0000 7f87f7400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f87dc06c8f0 0x7f87dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.892+0000 7f87f7400640 1 -- 172.21.15.142:0/2845674805 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f87e808bf70 con 0x7f880006d8d0 2024-04-01T15:23:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.893+0000 7f87fea00640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f87dc06c8f0 0x7f87dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:47.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.894+0000 7f87fea00640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f87dc06c8f0 0x7f87dc06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87f0036000 tx=0x7f87f0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:47.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:47.896+0000 7f87f7400640 1 -- 172.21.15.142:0/2845674805 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f87e801c360 con 0x7f880006d8d0 2024-04-01T15:23:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.101+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88000b8930 con 0x7f880006d8d0 2024-04-01T15:23:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.103+0000 7f87f7400640 1 -- 172.21.15.142:0/2845674805 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16877 (secure 0 0 0) 0x7f87e805a3b0 con 0x7f880006d8d0 2024-04-01T15:23:48.104 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:23:48.104 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":22,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:22:39.720405+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:23:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f87dc06c8f0 msgr2=0x7f87dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f87dc06c8f0 0x7f87dc06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87f0036000 tx=0x7f87f0008030 comp rx=0 tx=0).stop 2024-04-01T15:23:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f880006d8d0 msgr2=0x7f88001ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f880006d8d0 0x7f88001ceb60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f87e800d800 tx=0x7f87e800dcc0 comp rx=0 tx=0).stop 2024-04-01T15:23:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 shutdown_connections 2024-04-01T15:23:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f87dc06c8f0 0x7f87dc06edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8800149720 0x7f8800147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b0fb0 0x7f8800146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 --2- 172.21.15.142:0/2845674805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f880006d8d0 0x7f88001ceb60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 >> 172.21.15.142:0/2845674805 conn(0x7f88000b5890 msgr2=0x7f880013e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 shutdown_connections 2024-04-01T15:23:48.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:48.107+0000 7f8806400640 1 -- 172.21.15.142:0/2845674805 wait complete. 2024-04-01T15:23:49.128 INFO:tasks.ceph:Scrubbing osd.0 2024-04-01T15:23:49.128 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-01T15:23:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.345+0000 7fd8c5a00640 1 Processor -- start 2024-04-01T15:23:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.345+0000 7fd8c5a00640 1 -- start start 2024-04-01T15:23:49.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.346+0000 7fd8c5a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8c00b2d20 0x7fd8c01491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.346+0000 7fd8c5a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd8c0149720 0x7fd8c014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.346+0000 7fd8c5a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c00b3180 con 0x7fd8c006d8d0 2024-04-01T15:23:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.346+0000 7fd8c5a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c00b0b20 con 0x7fd8c00b2d20 2024-04-01T15:23:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.346+0000 7fd8c5a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c006dcb0 con 0x7fd8c0149720 2024-04-01T15:23:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.346+0000 7fd8be000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8c00b2d20 0x7fd8c01491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.346+0000 7fd8be000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8c00b2d20 0x7fd8c01491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37792/0 (socket says 172.21.15.142:37792) 2024-04-01T15:23:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.346+0000 7fd8be000640 1 -- 172.21.15.142:0/193591237 learned_addr learned my addr 172.21.15.142:0/193591237 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.347+0000 7fd8bf400640 1 --2- 172.21.15.142:0/193591237 >> v2:172.21.15.179:3300/0 conn(0x7fd8c0149720 0x7fd8c014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.347+0000 7fd8be000640 1 -- 172.21.15.142:0/193591237 >> v2:172.21.15.179:3300/0 conn(0x7fd8c0149720 msgr2=0x7fd8c014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.347+0000 7fd8be000640 1 --2- 172.21.15.142:0/193591237 >> v2:172.21.15.179:3300/0 conn(0x7fd8c0149720 0x7fd8c014fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.347+0000 7fd8be000640 1 -- 172.21.15.142:0/193591237 >> v1:172.21.15.179:6789/0 conn(0x7fd8c006d8d0 legacy=0x7fd8c00b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.347+0000 7fd8be000640 1 -- 172.21.15.142:0/193591237 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c0148ad0 con 0x7fd8c00b2d20 2024-04-01T15:23:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.348+0000 7fd8be000640 1 --2- 172.21.15.142:0/193591237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c00b2d20 0x7fd8c01491e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00b0ca0 tx=0x7fd8ac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc99435a31d8e5a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.348+0000 7fd8bd600640 1 -- 172.21.15.142:0/193591237 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac02e070 con 0x7fd8c00b2d20 2024-04-01T15:23:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.348+0000 7fd8bd600640 1 -- 172.21.15.142:0/193591237 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac037070 con 0x7fd8c00b2d20 2024-04-01T15:23:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.348+0000 7fd8bd600640 1 -- 172.21.15.142:0/193591237 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac031a00 con 0x7fd8c00b2d20 2024-04-01T15:23:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.349+0000 7fd8c5a00640 1 -- 172.21.15.142:0/193591237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c00b2d20 msgr2=0x7fd8c01491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.349+0000 7fd8c5a00640 1 --2- 172.21.15.142:0/193591237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c00b2d20 0x7fd8c01491e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00b0ca0 tx=0x7fd8ac02b880 comp rx=0 tx=0).stop 2024-04-01T15:23:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.349+0000 7fd8c5a00640 1 -- 172.21.15.142:0/193591237 shutdown_connections 2024-04-01T15:23:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.349+0000 7fd8c5a00640 1 --2- 172.21.15.142:0/193591237 >> v2:172.21.15.179:3300/0 conn(0x7fd8c0149720 0x7fd8c014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.349+0000 7fd8c5a00640 1 --2- 172.21.15.142:0/193591237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c00b2d20 0x7fd8c01491e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.349+0000 7fd8c5a00640 1 -- 172.21.15.142:0/193591237 >> 172.21.15.142:0/193591237 conn(0x7fd8c00b5890 msgr2=0x7fd8c00b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.349+0000 7fd8c5a00640 1 -- 172.21.15.142:0/193591237 shutdown_connections 2024-04-01T15:23:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.349+0000 7fd8c5a00640 1 -- 172.21.15.142:0/193591237 wait complete. 2024-04-01T15:23:49.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.350+0000 7fd8c5a00640 1 Processor -- start 2024-04-01T15:23:49.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.351+0000 7fd8c5a00640 1 -- start start 2024-04-01T15:23:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.351+0000 7fd8c5a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c006d8d0 0x7fd8c01456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.351+0000 7fd8c5a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8c00b2d20 0x7fd8c0070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.351+0000 7fd8c5a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c0149720 0x7fd8c00710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.351+0000 7fd8c5a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c00b16c0 con 0x7fd8c0149720 2024-04-01T15:23:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.351+0000 7fd8c5a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c00b5510 con 0x7fd8c00b2d20 2024-04-01T15:23:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.351+0000 7fd8c5a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c00b4e50 con 0x7fd8c006d8d0 2024-04-01T15:23:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bf400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c0149720 0x7fd8c00710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bf400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c0149720 0x7fd8c00710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37798/0 (socket says 172.21.15.142:37798) 2024-04-01T15:23:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bf400640 1 -- 172.21.15.142:0/3431078511 learned_addr learned my addr 172.21.15.142:0/3431078511 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bea00640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c006d8d0 0x7fd8c01456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8be000640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8c00b2d20 0x7fd8c0070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bf400640 1 -- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c006d8d0 msgr2=0x7fd8c01456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bf400640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8c006d8d0 0x7fd8c01456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bf400640 1 -- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8c00b2d20 msgr2=0x7fd8c0070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bf400640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8c00b2d20 0x7fd8c0070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bf400640 1 -- 172.21.15.142:0/3431078511 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c0144620 con 0x7fd8c0149720 2024-04-01T15:23:49.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.352+0000 7fd8bf400640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c0149720 0x7fd8c00710e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8007e40 tx=0x7fd8b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.353+0000 7fd8b6a00640 1 -- 172.21.15.142:0/3431078511 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8014620 con 0x7fd8c0149720 2024-04-01T15:23:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.353+0000 7fd8b6a00640 1 -- 172.21.15.142:0/3431078511 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b8019070 con 0x7fd8c0149720 2024-04-01T15:23:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.353+0000 7fd8b6a00640 1 -- 172.21.15.142:0/3431078511 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8014a20 con 0x7fd8c0149720 2024-04-01T15:23:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.353+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c0144900 con 0x7fd8c0149720 2024-04-01T15:23:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.353+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c0072700 con 0x7fd8c0149720 2024-04-01T15:23:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.354+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8c0068710 con 0x7fd8c0149720 2024-04-01T15:23:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.355+0000 7fd8b6a00640 1 -- 172.21.15.142:0/3431078511 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8b8014bc0 con 0x7fd8c0149720 2024-04-01T15:23:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.356+0000 7fd8b6a00640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd8a006c920 0x7fd8a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.356+0000 7fd8b6a00640 1 -- 172.21.15.142:0/3431078511 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd8b808c400 con 0x7fd8c0149720 2024-04-01T15:23:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.356+0000 7fd8b6a00640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7fd8a0074ca0 0x7fd8a0077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.356+0000 7fd8b6a00640 1 -- 172.21.15.142:0/3431078511 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8a00777f0 con 0x7fd8a0074ca0 2024-04-01T15:23:49.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.356+0000 7fd8b6a00640 1 -- 172.21.15.142:0/3431078511 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd8b8093050 con 0x7fd8c0149720 2024-04-01T15:23:49.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.356+0000 7fd8bea00640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd8a006c920 0x7fd8a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.356+0000 7fd8be000640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7fd8a0074ca0 0x7fd8a0077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.357+0000 7fd8be000640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7fd8a0074ca0 0x7fd8a0077120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:49.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.357+0000 7fd8bea00640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd8a006c920 0x7fd8a006ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0006fd0 tx=0x7fd8b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:49.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.358+0000 7fd8b6a00640 1 -- 172.21.15.142:0/3431078511 <== osd.0 v2:172.21.15.142:6808/3934118532 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8a00777f0 con 0x7fd8a0074ca0 2024-04-01T15:23:49.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.372+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 --> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd8c00b87c0 con 0x7fd8a0074ca0 2024-04-01T15:23:49.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.372+0000 7fd8b6a00640 1 -- 172.21.15.142:0/3431078511 <== osd.0 v2:172.21.15.142:6808/3934118532 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd8c00b87c0 con 0x7fd8a0074ca0 2024-04-01T15:23:49.374 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-01T15:23:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T15:23:49.374 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-01T15:23:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7fd8a0074ca0 msgr2=0x7fd8a0077120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.142:6808/3934118532,v1:172.21.15.142:6809/3934118532] conn(0x7fd8a0074ca0 0x7fd8a0077120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd8a006c920 msgr2=0x7fd8a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd8a006c920 0x7fd8a006ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0006fd0 tx=0x7fd8b0008040 comp rx=0 tx=0).stop 2024-04-01T15:23:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c0149720 msgr2=0x7fd8c00710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 --2- 172.21.15.142:0/3431078511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c0149720 0x7fd8c00710e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8007e40 tx=0x7fd8b800e4b0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8bf400640 1 -- 172.21.15.142:0/3431078511 reap_dead start 2024-04-01T15:23:49.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 shutdown_connections 2024-04-01T15:23:49.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 >> 172.21.15.142:0/3431078511 conn(0x7fd8c00b5890 msgr2=0x7fd8c0148cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:49.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 shutdown_connections 2024-04-01T15:23:49.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.373+0000 7fd8c5a00640 1 -- 172.21.15.142:0/3431078511 wait complete. 2024-04-01T15:23:49.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-01T15:23:49.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.596+0000 7fac89c00640 1 Processor -- start 2024-04-01T15:23:49.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.597+0000 7fac89c00640 1 -- start start 2024-04-01T15:23:49.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.598+0000 7fac89c00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fac840bd7e0 0x7fac840b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.598+0000 7fac89c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac840bdbc0 con 0x7fac8414ace0 2024-04-01T15:23:49.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.598+0000 7fac89c00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac840b5a40 con 0x7fac84141140 2024-04-01T15:23:49.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.598+0000 7fac89c00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fac840b57f0 con 0x7fac840bd7e0 2024-04-01T15:23:49.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.598+0000 7fac83400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fac8414ace0 0x7fac8414b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:32984/0 (socket says 172.21.15.142:32984) 2024-04-01T15:23:49.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.598+0000 7fac83400640 1 -- 172.21.15.142:0/1894060988 learned_addr learned my addr 172.21.15.142:0/1894060988 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:49.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.598+0000 7fac83e00640 1 --2- 172.21.15.142:0/1894060988 >> v2:172.21.15.179:3300/0 conn(0x7fac840bd7e0 0x7fac840b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3850190405 0 0) 0x7fac840bdbc0 con 0x7fac8414ace0 2024-04-01T15:23:49.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac64003520 con 0x7fac8414ace0 2024-04-01T15:23:49.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 737893474 0 0) 0x7fac64003520 con 0x7fac8414ace0 2024-04-01T15:23:49.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 >> v2:172.21.15.179:3300/0 conn(0x7fac840bd7e0 msgr2=0x7fac840b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:49.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 --2- 172.21.15.142:0/1894060988 >> v2:172.21.15.179:3300/0 conn(0x7fac840bd7e0 0x7fac840b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 >> v1:172.21.15.179:6789/0 conn(0x7fac84141140 legacy=0x7fac84141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac840b5d20 con 0x7fac8414ace0 2024-04-01T15:23:49.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7fac6c0019f0 con 0x7fac8414ace0 2024-04-01T15:23:49.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 >> v1:172.21.15.142:6789/0 conn(0x7fac8414ace0 legacy=0x7fac8414b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac640039b0 0x7fac64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac64004800 0x7fac64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac640051c0 0x7fac6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fac840b57f0 con 0x7fac640051c0 2024-04-01T15:23:49.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fac6400c160 con 0x7fac640039b0 2024-04-01T15:23:49.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fac6400c360 con 0x7fac64004800 2024-04-01T15:23:49.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.599+0000 7fac89200640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac640051c0 0x7fac6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.600+0000 7fac83e00640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac640039b0 0x7fac64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.600+0000 7fac83400640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac64004800 0x7fac64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.600+0000 7fac89200640 1 -- 172.21.15.142:0/1894060988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac64004800 msgr2=0x7fac64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:49.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.600+0000 7fac89200640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac64004800 0x7fac64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.600+0000 7fac89200640 1 -- 172.21.15.142:0/1894060988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac640039b0 msgr2=0x7fac64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:49.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.600+0000 7fac89200640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac640039b0 0x7fac64003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.600+0000 7fac89200640 1 -- 172.21.15.142:0/1894060988 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac64003520 con 0x7fac640051c0 2024-04-01T15:23:49.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.600+0000 7fac83400640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac64004800 0x7fac64004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:49.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.601+0000 7fac89200640 1 -- 172.21.15.142:0/1894060988 reap_dead start 2024-04-01T15:23:49.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.601+0000 7fac89200640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac640051c0 0x7fac6400b9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac7c001750 tx=0x7fac64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0d05ba7bb274cf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:49.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.601+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c001370 con 0x7fac640051c0 2024-04-01T15:23:49.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.601+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c0052f0 con 0x7fac640051c0 2024-04-01T15:23:49.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.601+0000 7fac82a00640 1 -- 172.21.15.142:0/1894060988 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c003830 con 0x7fac640051c0 2024-04-01T15:23:49.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.602+0000 7fac89c00640 1 -- 172.21.15.142:0/1894060988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac640051c0 msgr2=0x7fac6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.602+0000 7fac89c00640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac640051c0 0x7fac6400b9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac7c001750 tx=0x7fac64005830 comp rx=0 tx=0).stop 2024-04-01T15:23:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.602+0000 7fac89c00640 1 -- 172.21.15.142:0/1894060988 shutdown_connections 2024-04-01T15:23:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.602+0000 7fac89c00640 1 --2- 172.21.15.142:0/1894060988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac640051c0 0x7fac6400b9c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.602+0000 7fac89c00640 1 -- 172.21.15.142:0/1894060988 >> 172.21.15.142:0/1894060988 conn(0x7fac84073280 msgr2=0x7fac840bce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.602+0000 7fac89c00640 1 -- 172.21.15.142:0/1894060988 shutdown_connections 2024-04-01T15:23:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.602+0000 7fac89c00640 1 -- 172.21.15.142:0/1894060988 wait complete. 2024-04-01T15:23:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.603+0000 7fac89c00640 1 Processor -- start 2024-04-01T15:23:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.604+0000 7fac89c00640 1 -- start start 2024-04-01T15:23:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.604+0000 7fac89c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac640051c0 0x7fac84143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.604+0000 7fac89c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac841e0770 0x7fac841e0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.604+0000 7fac89c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8413e340 0x7fac8413e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.604+0000 7fac89c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fac840b4ae0 con 0x7fac8413e340 2024-04-01T15:23:49.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.604+0000 7fac89c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fac840b6c60 con 0x7fac841e0770 2024-04-01T15:23:49.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.604+0000 7fac89c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fac840b4c60 con 0x7fac640051c0 2024-04-01T15:23:49.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac89200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8413e340 0x7fac8413e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac89200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8413e340 0x7fac8413e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37818/0 (socket says 172.21.15.142:37818) 2024-04-01T15:23:49.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac89200640 1 -- 172.21.15.142:0/3304396962 learned_addr learned my addr 172.21.15.142:0/3304396962 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:49.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac83e00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac640051c0 0x7fac84143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac89200640 1 -- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac640051c0 msgr2=0x7fac84143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac89200640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac640051c0 0x7fac84143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac89200640 1 -- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac841e0770 msgr2=0x7fac841e0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac83400640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac841e0770 0x7fac841e0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac89200640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac841e0770 0x7fac841e0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac89200640 1 -- 172.21.15.142:0/3304396962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac841e1130 con 0x7fac8413e340 2024-04-01T15:23:49.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac83e00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac640051c0 0x7fac84143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:49.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.605+0000 7fac89200640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8413e340 0x7fac8413e7c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005040 tx=0x7fac7c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:49.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.606+0000 7fac7be00640 1 -- 172.21.15.142:0/3304396962 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c007a30 con 0x7fac8413e340 2024-04-01T15:23:49.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.606+0000 7fac7be00640 1 -- 172.21.15.142:0/3304396962 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c0054a0 con 0x7fac8413e340 2024-04-01T15:23:49.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.606+0000 7fac7be00640 1 -- 172.21.15.142:0/3304396962 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c03e890 con 0x7fac8413e340 2024-04-01T15:23:49.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.606+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac841d3af0 con 0x7fac8413e340 2024-04-01T15:23:49.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.606+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac841d3530 con 0x7fac8413e340 2024-04-01T15:23:49.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.607+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac841e0450 con 0x7fac8413e340 2024-04-01T15:23:49.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.608+0000 7fac7be00640 1 -- 172.21.15.142:0/3304396962 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac7c03ec40 con 0x7fac8413e340 2024-04-01T15:23:49.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.609+0000 7fac7be00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fac6006c8f0 0x7fac6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:49.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.609+0000 7fac7be00640 1 -- 172.21.15.142:0/3304396962 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fac7c0ac820 con 0x7fac8413e340 2024-04-01T15:23:49.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.610+0000 7fac83e00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fac6006c8f0 0x7fac6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:49.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.611+0000 7fac83e00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fac6006c8f0 0x7fac6006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac84148890 tx=0x7fac74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:49.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.614+0000 7fac7be00640 1 -- 172.21.15.142:0/3304396962 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fac841e0450 con 0x7fac8413e340 2024-04-01T15:23:49.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.813+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fac84068590 con 0x7fac6006c8f0 2024-04-01T15:23:49.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.814+0000 7fac7be00640 1 -- 172.21.15.142:0/3304396962 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac84068590 con 0x7fac6006c8f0 2024-04-01T15:23:49.815 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 0 to deep-scrub 2024-04-01T15:23:49.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fac6006c8f0 msgr2=0x7fac6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fac6006c8f0 0x7fac6006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac84148890 tx=0x7fac74008040 comp rx=0 tx=0).stop 2024-04-01T15:23:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8413e340 msgr2=0x7fac8413e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8413e340 0x7fac8413e7c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005040 tx=0x7fac7c001120 comp rx=0 tx=0).stop 2024-04-01T15:23:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 shutdown_connections 2024-04-01T15:23:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fac6006c8f0 0x7fac6006edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8413e340 0x7fac8413e7c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac841e0770 0x7fac841e0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 --2- 172.21.15.142:0/3304396962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac640051c0 0x7fac84143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:49.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 >> 172.21.15.142:0/3304396962 conn(0x7fac84073280 msgr2=0x7fac840bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:49.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 shutdown_connections 2024-04-01T15:23:49.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:49.817+0000 7fac89c00640 1 -- 172.21.15.142:0/3304396962 wait complete. 2024-04-01T15:23:49.836 INFO:tasks.ceph:Scrubbing osd.1 2024-04-01T15:23:49.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-01T15:23:50.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.049+0000 7f54be600640 1 Processor -- start 2024-04-01T15:23:50.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.049+0000 7f54be600640 1 -- start start 2024-04-01T15:23:50.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.050+0000 7f54be600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54b80b51c0 0x7f54b814ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.050+0000 7f54be600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54b80b22a0 0x7f54b80aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.050+0000 7f54be600640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54b80b55a0 con 0x7f54b80afae0 2024-04-01T15:23:50.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.050+0000 7f54be600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f54b80b0430 con 0x7f54b80b22a0 2024-04-01T15:23:50.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.050+0000 7f54be600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f54b80ae8c0 con 0x7f54b80b51c0 2024-04-01T15:23:50.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.051+0000 7f54b7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54b80b22a0 0x7f54b80aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.051+0000 7f54b7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54b80b22a0 0x7f54b80aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37834/0 (socket says 172.21.15.142:37834) 2024-04-01T15:23:50.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.051+0000 7f54b7e00640 1 -- 172.21.15.142:0/1792654961 learned_addr learned my addr 172.21.15.142:0/1792654961 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:50.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.051+0000 7f54b7400640 1 --2- 172.21.15.142:0/1792654961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54b80b51c0 0x7f54b814ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.051+0000 7f54b7e00640 1 -- 172.21.15.142:0/1792654961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54b80b51c0 msgr2=0x7f54b814ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:50.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.051+0000 7f54b7e00640 1 --2- 172.21.15.142:0/1792654961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54b80b51c0 0x7f54b814ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.051+0000 7f54b7e00640 1 -- 172.21.15.142:0/1792654961 >> v1:172.21.15.179:6789/0 conn(0x7f54b80afae0 legacy=0x7f54b80b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.051+0000 7f54b7e00640 1 -- 172.21.15.142:0/1792654961 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b806db20 con 0x7f54b80b22a0 2024-04-01T15:23:50.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.052+0000 7f54b7e00640 1 --2- 172.21.15.142:0/1792654961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b22a0 0x7f54b80aede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009e50 tx=0x7f54b002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adfb11ebc4c6d2e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.052+0000 7f54b6a00640 1 -- 172.21.15.142:0/1792654961 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b002c9e0 con 0x7f54b80b22a0 2024-04-01T15:23:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.052+0000 7f54b6a00640 1 -- 172.21.15.142:0/1792654961 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b002cb80 con 0x7f54b80b22a0 2024-04-01T15:23:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.052+0000 7f54b6a00640 1 -- 172.21.15.142:0/1792654961 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b00343f0 con 0x7f54b80b22a0 2024-04-01T15:23:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.053+0000 7f54be600640 1 -- 172.21.15.142:0/1792654961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b22a0 msgr2=0x7f54b80aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.053+0000 7f54be600640 1 --2- 172.21.15.142:0/1792654961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b22a0 0x7f54b80aede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009e50 tx=0x7f54b002be40 comp rx=0 tx=0).stop 2024-04-01T15:23:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.053+0000 7f54be600640 1 -- 172.21.15.142:0/1792654961 shutdown_connections 2024-04-01T15:23:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.053+0000 7f54be600640 1 --2- 172.21.15.142:0/1792654961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b22a0 0x7f54b80aede0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.053+0000 7f54be600640 1 --2- 172.21.15.142:0/1792654961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54b80b51c0 0x7f54b814ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.053+0000 7f54be600640 1 -- 172.21.15.142:0/1792654961 >> 172.21.15.142:0/1792654961 conn(0x7f54b80b5890 msgr2=0x7f54b80b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.053+0000 7f54be600640 1 -- 172.21.15.142:0/1792654961 shutdown_connections 2024-04-01T15:23:50.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.053+0000 7f54be600640 1 -- 172.21.15.142:0/1792654961 wait complete. 2024-04-01T15:23:50.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.055+0000 7f54be600640 1 Processor -- start 2024-04-01T15:23:50.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.055+0000 7f54be600640 1 -- start start 2024-04-01T15:23:50.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54be600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54b80b22a0 0x7f54b81402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54be600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b51c0 0x7f54b8142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54be600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b81423a0 0x7f54b81483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54be600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f54b80ae2f0 con 0x7f54b80b51c0 2024-04-01T15:23:50.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54be600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f54b80ae170 con 0x7f54b81423a0 2024-04-01T15:23:50.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54be600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f54b81521c0 con 0x7f54b80b22a0 2024-04-01T15:23:50.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54afe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b51c0 0x7f54b8142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54afe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b51c0 0x7f54b8142ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37840/0 (socket says 172.21.15.142:37840) 2024-04-01T15:23:50.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54afe00640 1 -- 172.21.15.142:0/4036666001 learned_addr learned my addr 172.21.15.142:0/4036666001 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:50.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.056+0000 7f54b7400640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54b80b22a0 0x7f54b81402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54b7e00640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b81423a0 0x7f54b81483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54afe00640 1 -- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54b80b22a0 msgr2=0x7f54b81402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54afe00640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54b80b22a0 0x7f54b81402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54afe00640 1 -- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b81423a0 msgr2=0x7f54b81483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54afe00640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b81423a0 0x7f54b81483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54afe00640 1 -- 172.21.15.142:0/4036666001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b8142880 con 0x7f54b80b51c0 2024-04-01T15:23:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54afe00640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b51c0 0x7f54b8142ff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c3a0 tx=0x7f54a000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54af400640 1 -- 172.21.15.142:0/4036666001 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a00052d0 con 0x7f54b80b51c0 2024-04-01T15:23:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54af400640 1 -- 172.21.15.142:0/4036666001 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a0005490 con 0x7f54b80b51c0 2024-04-01T15:23:50.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b8142bc0 con 0x7f54b80b51c0 2024-04-01T15:23:50.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.057+0000 7f54af400640 1 -- 172.21.15.142:0/4036666001 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0007260 con 0x7f54b80b51c0 2024-04-01T15:23:50.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.058+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b81dd9a0 con 0x7f54b80b51c0 2024-04-01T15:23:50.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.058+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54b8068710 con 0x7f54b80b51c0 2024-04-01T15:23:50.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.059+0000 7f54af400640 1 -- 172.21.15.142:0/4036666001 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f54a0007400 con 0x7f54b80b51c0 2024-04-01T15:23:50.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.060+0000 7f54af400640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f549406c8f0 0x7f549406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.060+0000 7f54af400640 1 -- 172.21.15.142:0/4036666001 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f54a008b0c0 con 0x7f54b80b51c0 2024-04-01T15:23:50.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.061+0000 7f54af400640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f5494074c70 0x7f54940770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.061+0000 7f54af400640 1 -- 172.21.15.142:0/4036666001 --> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54a0009e50 con 0x7f5494074c70 2024-04-01T15:23:50.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.061+0000 7f54af400640 1 -- 172.21.15.142:0/4036666001 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f54a0092050 con 0x7f54b80b51c0 2024-04-01T15:23:50.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.061+0000 7f54b7400640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f549406c8f0 0x7f549406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.061+0000 7f54b7e00640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f5494074c70 0x7f54940770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.062+0000 7f54b7e00640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f5494074c70 0x7f54940770f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.062+0000 7f54b7400640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f549406c8f0 0x7f549406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006fd0 tx=0x7f54a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.062+0000 7f54af400640 1 -- 172.21.15.142:0/4036666001 <== osd.1 v2:172.21.15.142:6821/2553070769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54a0009e50 con 0x7f5494074c70 2024-04-01T15:23:50.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.077+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 --> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54b8148fa0 con 0x7f5494074c70 2024-04-01T15:23:50.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54af400640 1 -- 172.21.15.142:0/4036666001 <== osd.1 v2:172.21.15.142:6821/2553070769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f54b8148fa0 con 0x7f5494074c70 2024-04-01T15:23:50.079 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-01T15:23:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T15:23:50.079 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-01T15:23:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f5494074c70 msgr2=0x7f54940770f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54be600640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.142:6821/2553070769,v1:172.21.15.142:6823/2553070769] conn(0x7f5494074c70 0x7f54940770f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f549406c8f0 msgr2=0x7f549406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54be600640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f549406c8f0 0x7f549406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006fd0 tx=0x7f54a8008040 comp rx=0 tx=0).stop 2024-04-01T15:23:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b51c0 msgr2=0x7f54b8142ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54be600640 1 --2- 172.21.15.142:0/4036666001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b80b51c0 0x7f54b8142ff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c3a0 tx=0x7f54a000c860 comp rx=0 tx=0).stop 2024-04-01T15:23:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54b7e00640 1 -- 172.21.15.142:0/4036666001 reap_dead start 2024-04-01T15:23:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 shutdown_connections 2024-04-01T15:23:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 >> 172.21.15.142:0/4036666001 conn(0x7f54b80b5890 msgr2=0x7f54b80b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.078+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 shutdown_connections 2024-04-01T15:23:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.079+0000 7f54be600640 1 -- 172.21.15.142:0/4036666001 wait complete. 2024-04-01T15:23:50.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-01T15:23:50.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.291+0000 7f97f2800640 1 Processor -- start 2024-04-01T15:23:50.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.292+0000 7f97f2800640 1 -- start start 2024-04-01T15:23:50.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97f2800640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aefa0 0x7f97ec0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97f2800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec0b0290 0x7f97ec0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97f2800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97ec06dcb0 con 0x7f97ec06d8d0 2024-04-01T15:23:50.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97f2800640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f97ec0b1790 con 0x7f97ec0aefa0 2024-04-01T15:23:50.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97f2800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f97ec0b14b0 con 0x7f97ec0b0290 2024-04-01T15:23:50.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97eb400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f97ec06d8d0 0x7f97ec0ae890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:32996/0 (socket says 172.21.15.142:32996) 2024-04-01T15:23:50.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97eb400640 1 -- 172.21.15.142:0/2750033458 learned_addr learned my addr 172.21.15.142:0/2750033458 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:50.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97ebe00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec0b0290 0x7f97ec0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97e3e00640 1 --2- 172.21.15.142:0/2750033458 >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aefa0 0x7f97ec0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.293+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422283375 0 0) 0x7f97ec06dcb0 con 0x7f97ec06d8d0 2024-04-01T15:23:50.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97cc003520 con 0x7f97ec06d8d0 2024-04-01T15:23:50.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1054929678 0 0) 0x7f97cc003520 con 0x7f97ec06d8d0 2024-04-01T15:23:50.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec0b0290 msgr2=0x7f97ec0b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:50.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec0b0290 0x7f97ec0b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aefa0 msgr2=0x7f97ec0b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:50.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 --2- 172.21.15.142:0/2750033458 >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aefa0 0x7f97ec0b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ec0b53b0 con 0x7f97ec06d8d0 2024-04-01T15:23:50.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f97dc001670 con 0x7f97ec06d8d0 2024-04-01T15:23:50.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 >> v1:172.21.15.142:6789/0 conn(0x7f97ec06d8d0 legacy=0x7f97ec0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97cc0039b0 0x7f97cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97cc004800 0x7f97cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec0b0290 0x7f97cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec0b1790 con 0x7f97cc004800 2024-04-01T15:23:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec0b14b0 con 0x7f97cc0039b0 2024-04-01T15:23:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc00dbd0 con 0x7f97ec0b0290 2024-04-01T15:23:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.294+0000 7f97e3e00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97cc004800 0x7f97cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.295+0000 7f97ebe00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec0b0290 0x7f97cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.295+0000 7f97eb400640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97cc0039b0 0x7f97cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.295+0000 7f97e3e00640 1 -- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec0b0290 msgr2=0x7f97cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.295+0000 7f97e3e00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec0b0290 0x7f97cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.295+0000 7f97e3e00640 1 -- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97cc0039b0 msgr2=0x7f97cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:50.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.295+0000 7f97e3e00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97cc0039b0 0x7f97cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.295+0000 7f97e3e00640 1 -- 172.21.15.142:0/2750033458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc003520 con 0x7f97cc004800 2024-04-01T15:23:50.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.296+0000 7f97e3e00640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97cc004800 0x7f97cc004c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009ac0 tx=0x7f97cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3644a6e85141f3ac server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.296+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4039070 con 0x7f97cc004800 2024-04-01T15:23:50.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.296+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d402c710 con 0x7f97cc004800 2024-04-01T15:23:50.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.296+0000 7f97eaa00640 1 -- 172.21.15.142:0/2750033458 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4009690 con 0x7f97cc004800 2024-04-01T15:23:50.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.297+0000 7f97f2800640 1 -- 172.21.15.142:0/2750033458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97cc004800 msgr2=0x7f97cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.297+0000 7f97f2800640 1 --2- 172.21.15.142:0/2750033458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97cc004800 0x7f97cc004c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009ac0 tx=0x7f97cc005830 comp rx=0 tx=0).stop 2024-04-01T15:23:50.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.297+0000 7f97ebe00640 1 -- 172.21.15.142:0/2750033458 reap_dead start 2024-04-01T15:23:50.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.297+0000 7f97f2800640 1 -- 172.21.15.142:0/2750033458 shutdown_connections 2024-04-01T15:23:50.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.297+0000 7f97f2800640 1 -- 172.21.15.142:0/2750033458 >> 172.21.15.142:0/2750033458 conn(0x7f97ec0b5890 msgr2=0x7f97ec0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:50.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.297+0000 7f97f2800640 1 -- 172.21.15.142:0/2750033458 shutdown_connections 2024-04-01T15:23:50.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.297+0000 7f97f2800640 1 -- 172.21.15.142:0/2750033458 wait complete. 2024-04-01T15:23:50.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.298+0000 7f97f2800640 1 Processor -- start 2024-04-01T15:23:50.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.299+0000 7f97f2800640 1 -- start start 2024-04-01T15:23:50.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.299+0000 7f97f2800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97cc004800 0x7f97ec1e0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.299+0000 7f97f2800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97ec1c7fa0 0x7f97ec1c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.299+0000 7f97f2800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec09bae0 0x7f97ec09bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.299+0000 7f97f2800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec0ae370 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.299+0000 7f97f2800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec0ae090 con 0x7f97ec09bae0 2024-04-01T15:23:50.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.299+0000 7f97f2800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f97ec0b2160 con 0x7f97cc004800 2024-04-01T15:23:50.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97e3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97ec1c7fa0 0x7f97ec1c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97e3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97ec1c7fa0 0x7f97ec1c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37854/0 (socket says 172.21.15.142:37854) 2024-04-01T15:23:50.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97e3e00640 1 -- 172.21.15.142:0/1171622945 learned_addr learned my addr 172.21.15.142:0/1171622945 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:50.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97eb400640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97cc004800 0x7f97ec1e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97ebe00640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec09bae0 0x7f97ec09bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97e3e00640 1 -- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97cc004800 msgr2=0x7f97ec1e0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97e3e00640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97cc004800 0x7f97ec1e0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97e3e00640 1 -- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec09bae0 msgr2=0x7f97ec09bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97e3e00640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec09bae0 0x7f97ec09bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97e3e00640 1 -- 172.21.15.142:0/1171622945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ec09c4a0 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97eb400640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97cc004800 0x7f97ec1e0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.300+0000 7f97e3e00640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97ec1c7fa0 0x7f97ec1c8420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f97d4000c00 tx=0x7f97d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.301+0000 7f97e3400640 1 -- 172.21.15.142:0/1171622945 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4039050 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.301+0000 7f97e3400640 1 -- 172.21.15.142:0/1171622945 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d4045070 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.301+0000 7f97e3400640 1 -- 172.21.15.142:0/1171622945 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4003a50 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.301+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ec09e600 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.301+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ec1e1310 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.302+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ec1e0e50 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.303+0000 7f97e3400640 1 -- 172.21.15.142:0/1171622945 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97d4003bf0 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.304+0000 7f97e3400640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f97c806c8f0 0x7f97c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.304+0000 7f97e3400640 1 -- 172.21.15.142:0/1171622945 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f97d40ad770 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.304+0000 7f97eb400640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f97c806c8f0 0x7f97c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.305+0000 7f97eb400640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f97c806c8f0 0x7f97c806edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f97dc000f60 tx=0x7f97dc000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.308+0000 7f97e3400640 1 -- 172.21.15.142:0/1171622945 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f97ec1e0e50 con 0x7f97ec1c7fa0 2024-04-01T15:23:50.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.508+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f97ec068710 con 0x7f97c806c8f0 2024-04-01T15:23:50.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.510+0000 7f97e3400640 1 -- 172.21.15.142:0/1171622945 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f97ec068710 con 0x7f97c806c8f0 2024-04-01T15:23:50.511 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 1 to deep-scrub 2024-04-01T15:23:50.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.512+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f97c806c8f0 msgr2=0x7f97c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.512+0000 7f97f2800640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f97c806c8f0 0x7f97c806edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f97dc000f60 tx=0x7f97dc000ed0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.512+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97ec1c7fa0 msgr2=0x7f97ec1c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.512+0000 7f97f2800640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97ec1c7fa0 0x7f97ec1c8420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f97d4000c00 tx=0x7f97d4004730 comp rx=0 tx=0).stop 2024-04-01T15:23:50.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.513+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 shutdown_connections 2024-04-01T15:23:50.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.513+0000 7f97f2800640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f97c806c8f0 0x7f97c806edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.513+0000 7f97f2800640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec09bae0 0x7f97ec09bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.513+0000 7f97f2800640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97ec1c7fa0 0x7f97ec1c8420 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.513+0000 7f97f2800640 1 --2- 172.21.15.142:0/1171622945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97cc004800 0x7f97ec1e0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.513+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 >> 172.21.15.142:0/1171622945 conn(0x7f97ec0b5890 msgr2=0x7f97ec067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:50.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.513+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 shutdown_connections 2024-04-01T15:23:50.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.513+0000 7f97f2800640 1 -- 172.21.15.142:0/1171622945 wait complete. 2024-04-01T15:23:50.534 INFO:tasks.ceph:Scrubbing osd.2 2024-04-01T15:23:50.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-01T15:23:50.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.738+0000 7f5e00600640 1 Processor -- start 2024-04-01T15:23:50.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.738+0000 7f5e00600640 1 -- start start 2024-04-01T15:23:50.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.740+0000 7f5e00600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5df806d8d0 0x7f5df80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.740+0000 7f5e00600640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5df80b0fb0 0x7f5df81491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.740+0000 7f5e00600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df806dcb0 con 0x7f5df8149720 2024-04-01T15:23:50.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.740+0000 7f5e00600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5df80b0b20 con 0x7f5df806d8d0 2024-04-01T15:23:50.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.740+0000 7f5e00600640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f5df8148ad0 con 0x7f5df80b0fb0 2024-04-01T15:23:50.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.740+0000 7f5dfe600640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5df8149720 0x7f5df80b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33006/0 (socket says 172.21.15.142:33006) 2024-04-01T15:23:50.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.740+0000 7f5dfe600640 1 -- 172.21.15.142:0/1743943839 learned_addr learned my addr 172.21.15.142:0/1743943839 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:50.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.740+0000 7f5dfdc00640 1 --2- 172.21.15.142:0/1743943839 >> v2:172.21.15.142:3300/0 conn(0x7f5df806d8d0 0x7f5df80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.740+0000 7f5dfd200640 1 --2- 172.21.15.142:0/1743943839 >> v2:172.21.15.179:3300/0 conn(0x7f5df80b0fb0 0x7f5df81491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.741+0000 7f5df7e00640 1 -- 172.21.15.142:0/1743943839 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212794921 0 0) 0x7f5df806dcb0 con 0x7f5df8149720 2024-04-01T15:23:50.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.741+0000 7f5df7e00640 1 -- 172.21.15.142:0/1743943839 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de0003520 con 0x7f5df8149720 2024-04-01T15:23:50.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.741+0000 7f5dfdc00640 1 -- 172.21.15.142:0/1743943839 >> v2:172.21.15.179:3300/0 conn(0x7f5df80b0fb0 msgr2=0x7f5df81491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:50.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.741+0000 7f5dfdc00640 1 --2- 172.21.15.142:0/1743943839 >> v2:172.21.15.179:3300/0 conn(0x7f5df80b0fb0 0x7f5df81491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.741+0000 7f5dfdc00640 1 -- 172.21.15.142:0/1743943839 >> v1:172.21.15.142:6789/0 conn(0x7f5df8149720 legacy=0x7f5df80b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.741+0000 7f5dfdc00640 1 -- 172.21.15.142:0/1743943839 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df80b5230 con 0x7f5df806d8d0 2024-04-01T15:23:50.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.741+0000 7f5dfd200640 1 --2- 172.21.15.142:0/1743943839 >> v2:172.21.15.179:3300/0 conn(0x7f5df80b0fb0 0x7f5df81491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:23:50.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.742+0000 7f5dfdc00640 1 --2- 172.21.15.142:0/1743943839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df806d8d0 0x7f5df80b2d20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5df80b66f0 tx=0x7f5dec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cbe6d7ae11fdf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.742+0000 7f5df7e00640 1 -- 172.21.15.142:0/1743943839 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec0315a0 con 0x7f5df806d8d0 2024-04-01T15:23:50.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.742+0000 7f5df7e00640 1 -- 172.21.15.142:0/1743943839 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec037070 con 0x7f5df806d8d0 2024-04-01T15:23:50.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.742+0000 7f5df7e00640 1 -- 172.21.15.142:0/1743943839 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec031940 con 0x7f5df806d8d0 2024-04-01T15:23:50.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.743+0000 7f5e00600640 1 -- 172.21.15.142:0/1743943839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df806d8d0 msgr2=0x7f5df80b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.743+0000 7f5e00600640 1 --2- 172.21.15.142:0/1743943839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df806d8d0 0x7f5df80b2d20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5df80b66f0 tx=0x7f5dec02b840 comp rx=0 tx=0).stop 2024-04-01T15:23:50.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.743+0000 7f5e00600640 1 -- 172.21.15.142:0/1743943839 shutdown_connections 2024-04-01T15:23:50.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.743+0000 7f5e00600640 1 --2- 172.21.15.142:0/1743943839 >> v2:172.21.15.179:3300/0 conn(0x7f5df80b0fb0 0x7f5df81491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.743+0000 7f5e00600640 1 --2- 172.21.15.142:0/1743943839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df806d8d0 0x7f5df80b2d20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.743+0000 7f5e00600640 1 -- 172.21.15.142:0/1743943839 >> 172.21.15.142:0/1743943839 conn(0x7f5df80b5890 msgr2=0x7f5df80b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:50.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.743+0000 7f5e00600640 1 -- 172.21.15.142:0/1743943839 shutdown_connections 2024-04-01T15:23:50.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.743+0000 7f5e00600640 1 -- 172.21.15.142:0/1743943839 wait complete. 2024-04-01T15:23:50.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.744+0000 7f5e00600640 1 Processor -- start 2024-04-01T15:23:50.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.745+0000 7f5e00600640 1 -- start start 2024-04-01T15:23:50.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.745+0000 7f5e00600640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df806d8d0 0x7f5df806fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.745+0000 7f5e00600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df80b0fb0 0x7f5df81dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.745+0000 7f5e00600640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df8149720 0x7f5df813e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.745+0000 7f5e00600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80b4fd0 con 0x7f5df80b0fb0 2024-04-01T15:23:50.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.745+0000 7f5e00600640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80b4e50 con 0x7f5df806d8d0 2024-04-01T15:23:50.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.745+0000 7f5e00600640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5df809edc0 con 0x7f5df8149720 2024-04-01T15:23:50.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfd200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df80b0fb0 0x7f5df81dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfd200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df80b0fb0 0x7f5df81dd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37872/0 (socket says 172.21.15.142:37872) 2024-04-01T15:23:50.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfd200640 1 -- 172.21.15.142:0/146889811 learned_addr learned my addr 172.21.15.142:0/146889811 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:50.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfdc00640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df806d8d0 0x7f5df806fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfd200640 1 -- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df8149720 msgr2=0x7f5df813e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfd200640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df8149720 0x7f5df813e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfd200640 1 -- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df806d8d0 msgr2=0x7f5df806fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfd200640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df806d8d0 0x7f5df806fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfd200640 1 -- 172.21.15.142:0/146889811 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df80720f0 con 0x7f5df80b0fb0 2024-04-01T15:23:50.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfdc00640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df806d8d0 0x7f5df806fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:50.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5dfd200640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df80b0fb0 0x7f5df81dd2b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5de400e730 tx=0x7f5de400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5df5600640 1 -- 172.21.15.142:0/146889811 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de400f040 con 0x7f5df80b0fb0 2024-04-01T15:23:50.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.746+0000 7f5df5600640 1 -- 172.21.15.142:0/146889811 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de4004230 con 0x7f5df80b0fb0 2024-04-01T15:23:50.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.747+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df8071e10 con 0x7f5df80b0fb0 2024-04-01T15:23:50.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.747+0000 7f5df5600640 1 -- 172.21.15.142:0/146889811 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de400ee40 con 0x7f5df80b0fb0 2024-04-01T15:23:50.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.747+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df8141f10 con 0x7f5df80b0fb0 2024-04-01T15:23:50.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.748+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5df8068710 con 0x7f5df80b0fb0 2024-04-01T15:23:50.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.748+0000 7f5df5600640 1 -- 172.21.15.142:0/146889811 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5de400c6d0 con 0x7f5df80b0fb0 2024-04-01T15:23:50.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.749+0000 7f5df5600640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5dd806c8f0 0x7f5dd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.749+0000 7f5df5600640 1 -- 172.21.15.142:0/146889811 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5de408b900 con 0x7f5df80b0fb0 2024-04-01T15:23:50.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.750+0000 7f5df5600640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f5dd8074c70 0x7f5dd80770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.750+0000 7f5df5600640 1 -- 172.21.15.142:0/146889811 --> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5dd80777c0 con 0x7f5dd8074c70 2024-04-01T15:23:50.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.750+0000 7f5df5600640 1 -- 172.21.15.142:0/146889811 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5de40902c0 con 0x7f5df80b0fb0 2024-04-01T15:23:50.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.750+0000 7f5dfdc00640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5dd806c8f0 0x7f5dd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.750+0000 7f5dfe600640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f5dd8074c70 0x7f5dd80770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.750+0000 7f5dfe600640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f5dd8074c70 0x7f5dd80770f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.751+0000 7f5dfdc00640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5dd806c8f0 0x7f5dd806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5dec036000 tx=0x7f5dec008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.751+0000 7f5df5600640 1 -- 172.21.15.142:0/146889811 <== osd.2 v2:172.21.15.142:6816/894905692 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5dd80777c0 con 0x7f5dd8074c70 2024-04-01T15:23:50.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.765+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 --> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5df8146480 con 0x7f5dd8074c70 2024-04-01T15:23:50.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.766+0000 7f5df5600640 1 -- 172.21.15.142:0/146889811 <== osd.2 v2:172.21.15.142:6816/894905692 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5df8146480 con 0x7f5dd8074c70 2024-04-01T15:23:50.767 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-01T15:23:50.767 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T15:23:50.768 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-01T15:23:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.766+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f5dd8074c70 msgr2=0x7f5dd80770f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.766+0000 7f5e00600640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.142:6816/894905692,v1:172.21.15.142:6817/894905692] conn(0x7f5dd8074c70 0x7f5dd80770f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.767+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5dd806c8f0 msgr2=0x7f5dd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.767+0000 7f5e00600640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5dd806c8f0 0x7f5dd806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5dec036000 tx=0x7f5dec008030 comp rx=0 tx=0).stop 2024-04-01T15:23:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.767+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df80b0fb0 msgr2=0x7f5df81dd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.767+0000 7f5e00600640 1 --2- 172.21.15.142:0/146889811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df80b0fb0 0x7f5df81dd2b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5de400e730 tx=0x7f5de400ebf0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.767+0000 7f5dfe600640 1 -- 172.21.15.142:0/146889811 reap_dead start 2024-04-01T15:23:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.767+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 shutdown_connections 2024-04-01T15:23:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.767+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 >> 172.21.15.142:0/146889811 conn(0x7f5df80b5890 msgr2=0x7f5df80b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.767+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 shutdown_connections 2024-04-01T15:23:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.767+0000 7f5e00600640 1 -- 172.21.15.142:0/146889811 wait complete. 2024-04-01T15:23:50.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-01T15:23:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.991+0000 7f7f77a00640 1 Processor -- start 2024-04-01T15:23:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.992+0000 7f7f77a00640 1 -- start start 2024-04-01T15:23:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.993+0000 7f7f77a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f700afae0 0x7f7f700b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.993+0000 7f7f77a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7014ae90 0x7f7f700aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.993+0000 7f7f77a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f700b55a0 con 0x7f7f700b51c0 2024-04-01T15:23:50.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.993+0000 7f7f77a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7f700b0430 con 0x7f7f700afae0 2024-04-01T15:23:50.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.993+0000 7f7f77a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f700ae8c0 con 0x7f7f7014ae90 2024-04-01T15:23:50.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.993+0000 7f7f75000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7f700b51c0 0x7f7f700b1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33014/0 (socket says 172.21.15.142:33014) 2024-04-01T15:23:50.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.993+0000 7f7f75000640 1 -- 172.21.15.142:0/2369157615 learned_addr learned my addr 172.21.15.142:0/2369157615 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:50.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.993+0000 7f7f67e00640 1 --2- 172.21.15.142:0/2369157615 >> v2:172.21.15.142:3300/0 conn(0x7f7f700afae0 0x7f7f700b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.993+0000 7f7f75a00640 1 --2- 172.21.15.142:0/2369157615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7014ae90 0x7f7f700aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:50.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.994+0000 7f7f6fe00640 1 -- 172.21.15.142:0/2369157615 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183509823 0 0) 0x7f7f700b55a0 con 0x7f7f700b51c0 2024-04-01T15:23:50.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.994+0000 7f7f67e00640 1 -- 172.21.15.142:0/2369157615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7014ae90 msgr2=0x7f7f700aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:50.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.994+0000 7f7f67e00640 1 --2- 172.21.15.142:0/2369157615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7014ae90 0x7f7f700aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.994+0000 7f7f67e00640 1 -- 172.21.15.142:0/2369157615 >> v1:172.21.15.142:6789/0 conn(0x7f7f700b51c0 legacy=0x7f7f700b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.994+0000 7f7f67e00640 1 -- 172.21.15.142:0/2369157615 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7006db20 con 0x7f7f700afae0 2024-04-01T15:23:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.995+0000 7f7f67e00640 1 --2- 172.21.15.142:0/2369157615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f700afae0 0x7f7f700b22a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7f580097a0 tx=0x7f7f5802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad75db5d738992a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.995+0000 7f7f6fe00640 1 -- 172.21.15.142:0/2369157615 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58039070 con 0x7f7f700afae0 2024-04-01T15:23:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.995+0000 7f7f6fe00640 1 -- 172.21.15.142:0/2369157615 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f580316f0 con 0x7f7f700afae0 2024-04-01T15:23:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.995+0000 7f7f6fe00640 1 -- 172.21.15.142:0/2369157615 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58031ac0 con 0x7f7f700afae0 2024-04-01T15:23:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.996+0000 7f7f77a00640 1 -- 172.21.15.142:0/2369157615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f700afae0 msgr2=0x7f7f700b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.996+0000 7f7f77a00640 1 --2- 172.21.15.142:0/2369157615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f700afae0 0x7f7f700b22a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7f580097a0 tx=0x7f7f5802b790 comp rx=0 tx=0).stop 2024-04-01T15:23:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.996+0000 7f7f77a00640 1 -- 172.21.15.142:0/2369157615 shutdown_connections 2024-04-01T15:23:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.996+0000 7f7f77a00640 1 --2- 172.21.15.142:0/2369157615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7014ae90 0x7f7f700aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.996+0000 7f7f77a00640 1 --2- 172.21.15.142:0/2369157615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f700afae0 0x7f7f700b22a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.996+0000 7f7f77a00640 1 -- 172.21.15.142:0/2369157615 >> 172.21.15.142:0/2369157615 conn(0x7f7f700b5890 msgr2=0x7f7f700b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.996+0000 7f7f77a00640 1 -- 172.21.15.142:0/2369157615 shutdown_connections 2024-04-01T15:23:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.996+0000 7f7f77a00640 1 -- 172.21.15.142:0/2369157615 wait complete. 2024-04-01T15:23:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.998+0000 7f7f77a00640 1 Processor -- start 2024-04-01T15:23:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.998+0000 7f7f77a00640 1 -- start start 2024-04-01T15:23:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.998+0000 7f7f77a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f700b51c0 0x7f7f7006f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f77a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f7014ae90 0x7f7f701e0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f77a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7013d560 0x7f7f700714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f77a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700ae2f0 con 0x7f7f7014ae90 2024-04-01T15:23:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f77a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700ae170 con 0x7f7f700b51c0 2024-04-01T15:23:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f77a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f701521c0 con 0x7f7f7013d560 2024-04-01T15:23:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f7014ae90 0x7f7f701e0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f7014ae90 0x7f7f701e0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37894/0 (socket says 172.21.15.142:37894) 2024-04-01T15:23:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f67e00640 1 -- 172.21.15.142:0/1077351416 learned_addr learned my addr 172.21.15.142:0/1077351416 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f75000640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f700b51c0 0x7f7f7006f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f75a00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7013d560 0x7f7f700714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f67e00640 1 -- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7013d560 msgr2=0x7f7f700714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f67e00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7013d560 0x7f7f700714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f67e00640 1 -- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f700b51c0 msgr2=0x7f7f7006f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f67e00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f700b51c0 0x7f7f7006f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:50.999+0000 7f7f67e00640 1 -- 172.21.15.142:0/1077351416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f70071c40 con 0x7f7f7014ae90 2024-04-01T15:23:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.000+0000 7f7f67e00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f7014ae90 0x7f7f701e0460 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f580097a0 tx=0x7f7f580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.000+0000 7f7f6d600640 1 -- 172.21.15.142:0/1077351416 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58039040 con 0x7f7f7014ae90 2024-04-01T15:23:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.000+0000 7f7f6d600640 1 -- 172.21.15.142:0/1077351416 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58004030 con 0x7f7f7014ae90 2024-04-01T15:23:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.000+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7013ab20 con 0x7f7f7014ae90 2024-04-01T15:23:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.000+0000 7f7f6d600640 1 -- 172.21.15.142:0/1077351416 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58004420 con 0x7f7f7014ae90 2024-04-01T15:23:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.000+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7013e0c0 con 0x7f7f7014ae90 2024-04-01T15:23:51.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.001+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f70068710 con 0x7f7f7014ae90 2024-04-01T15:23:51.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.002+0000 7f7f6d600640 1 -- 172.21.15.142:0/1077351416 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f5803c070 con 0x7f7f7014ae90 2024-04-01T15:23:51.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.003+0000 7f7f6d600640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7f4c06c920 0x7f7f4c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.003+0000 7f7f6d600640 1 -- 172.21.15.142:0/1077351416 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7f580ad670 con 0x7f7f7014ae90 2024-04-01T15:23:51.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.003+0000 7f7f75000640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7f4c06c920 0x7f7f4c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.005+0000 7f7f75000640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7f4c06c920 0x7f7f4c06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f60007fd0 tx=0x7f7f60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.008+0000 7f7f6d600640 1 -- 172.21.15.142:0/1077351416 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7f5804c030 con 0x7f7f7014ae90 2024-04-01T15:23:51.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.205+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f7f700b0ba0 con 0x7f7f4c06c920 2024-04-01T15:23:51.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.206+0000 7f7f6d600640 1 -- 172.21.15.142:0/1077351416 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7f700b0ba0 con 0x7f7f4c06c920 2024-04-01T15:23:51.207 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 2 to deep-scrub 2024-04-01T15:23:51.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7f4c06c920 msgr2=0x7f7f4c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7f4c06c920 0x7f7f4c06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f60007fd0 tx=0x7f7f60009040 comp rx=0 tx=0).stop 2024-04-01T15:23:51.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f7014ae90 msgr2=0x7f7f701e0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f7014ae90 0x7f7f701e0460 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f580097a0 tx=0x7f7f580046c0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 shutdown_connections 2024-04-01T15:23:51.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7f4c06c920 0x7f7f4c06ede0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f7013d560 0x7f7f700714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f7014ae90 0x7f7f701e0460 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 --2- 172.21.15.142:0/1077351416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f700b51c0 0x7f7f7006f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.208+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 >> 172.21.15.142:0/1077351416 conn(0x7f7f700b5890 msgr2=0x7f7f700b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:51.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.209+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 shutdown_connections 2024-04-01T15:23:51.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.209+0000 7f7f77a00640 1 -- 172.21.15.142:0/1077351416 wait complete. 2024-04-01T15:23:51.229 INFO:tasks.ceph:Scrubbing osd.3 2024-04-01T15:23:51.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-01T15:23:51.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:23:51.436 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:23:51.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.441+0000 7fed7c000640 1 Processor -- start 2024-04-01T15:23:51.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.442+0000 7fed7c000640 1 -- start start 2024-04-01T15:23:51.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.443+0000 7fed7c000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fed740bda60 0x7fed740b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.443+0000 7fed7c000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fed7414b7e0 0x7fed74141b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.443+0000 7fed7c000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed740bde40 con 0x7fed74141670 2024-04-01T15:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.443+0000 7fed7c000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fed740b5120 con 0x7fed740bda60 2024-04-01T15:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.443+0000 7fed7c000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fed740b53e0 con 0x7fed7414b7e0 2024-04-01T15:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.443+0000 7fed79600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fed740bda60 0x7fed740b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.443+0000 7fed78c00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fed74141670 0x7fed7414b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33024/0 (socket says 172.21.15.142:33024) 2024-04-01T15:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.443+0000 7fed78c00640 1 -- 172.21.15.142:0/3682712765 learned_addr learned my addr 172.21.15.142:0/3682712765 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.443+0000 7fed7a000640 1 --2- 172.21.15.142:0/3682712765 >> v2:172.21.15.179:3300/0 conn(0x7fed7414b7e0 0x7fed74141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.444+0000 7fed79600640 1 -- 172.21.15.142:0/3682712765 >> v2:172.21.15.179:3300/0 conn(0x7fed7414b7e0 msgr2=0x7fed74141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.444+0000 7fed79600640 1 --2- 172.21.15.142:0/3682712765 >> v2:172.21.15.179:3300/0 conn(0x7fed7414b7e0 0x7fed74141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.444+0000 7fed79600640 1 -- 172.21.15.142:0/3682712765 >> v1:172.21.15.142:6789/0 conn(0x7fed74141670 legacy=0x7fed7414b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.444+0000 7fed79600640 1 -- 172.21.15.142:0/3682712765 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed740b56c0 con 0x7fed740bda60 2024-04-01T15:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.444+0000 7fed73e00640 1 -- 172.21.15.142:0/3682712765 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384830940 0 0) 0x7fed740bde40 con 0x7fed74141670 2024-04-01T15:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.445+0000 7fed79600640 1 --2- 172.21.15.142:0/3682712765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed740bda60 0x7fed740b5fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fed740b5990 tx=0x7fed6802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8fd786b2e3f16 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.445+0000 7fed73e00640 1 -- 172.21.15.142:0/3682712765 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68038070 con 0x7fed740bda60 2024-04-01T15:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.445+0000 7fed73e00640 1 -- 172.21.15.142:0/3682712765 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed68031710 con 0x7fed740bda60 2024-04-01T15:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.445+0000 7fed73e00640 1 -- 172.21.15.142:0/3682712765 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68031ae0 con 0x7fed740bda60 2024-04-01T15:23:51.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.446+0000 7fed7c000640 1 -- 172.21.15.142:0/3682712765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed740bda60 msgr2=0x7fed740b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.446+0000 7fed7c000640 1 --2- 172.21.15.142:0/3682712765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed740bda60 0x7fed740b5fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fed740b5990 tx=0x7fed6802b7b0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.446+0000 7fed7c000640 1 -- 172.21.15.142:0/3682712765 shutdown_connections 2024-04-01T15:23:51.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.446+0000 7fed7c000640 1 --2- 172.21.15.142:0/3682712765 >> v2:172.21.15.179:3300/0 conn(0x7fed7414b7e0 0x7fed74141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.446+0000 7fed7c000640 1 --2- 172.21.15.142:0/3682712765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed740bda60 0x7fed740b5fd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.446+0000 7fed7c000640 1 -- 172.21.15.142:0/3682712765 >> 172.21.15.142:0/3682712765 conn(0x7fed740734b0 msgr2=0x7fed740bd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:51.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.446+0000 7fed7c000640 1 -- 172.21.15.142:0/3682712765 shutdown_connections 2024-04-01T15:23:51.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.446+0000 7fed7c000640 1 -- 172.21.15.142:0/3682712765 wait complete. 2024-04-01T15:23:51.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.448+0000 7fed7c000640 1 Processor -- start 2024-04-01T15:23:51.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.448+0000 7fed7c000640 1 -- start start 2024-04-01T15:23:51.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7c000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed740bda60 0x7fed74149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7c000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74141670 0x7fed74131350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7c000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed7414b7e0 0x7fed74131890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7c000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fed740b4b40 con 0x7fed7414b7e0 2024-04-01T15:23:51.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7c000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fed740b49c0 con 0x7fed740bda60 2024-04-01T15:23:51.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7c000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fed74152180 con 0x7fed74141670 2024-04-01T15:23:51.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7a000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed7414b7e0 0x7fed74131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7a000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed7414b7e0 0x7fed74131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37926/0 (socket says 172.21.15.142:37926) 2024-04-01T15:23:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7a000640 1 -- 172.21.15.142:0/702582345 learned_addr learned my addr 172.21.15.142:0/702582345 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed79600640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed740bda60 0x7fed74149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed78c00640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74141670 0x7fed74131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7a000640 1 -- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74141670 msgr2=0x7fed74131350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7a000640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74141670 0x7fed74131350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7a000640 1 -- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed740bda60 msgr2=0x7fed74149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7a000640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed740bda60 0x7fed74149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed7a000640 1 -- 172.21.15.142:0/702582345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed74143440 con 0x7fed7414b7e0 2024-04-01T15:23:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.449+0000 7fed79600640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed740bda60 0x7fed74149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.450+0000 7fed78c00640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74141670 0x7fed74131350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.450+0000 7fed7a000640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed7414b7e0 0x7fed74131890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed6c007e90 tx=0x7fed6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.450+0000 7fed71600640 1 -- 172.21.15.142:0/702582345 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c014420 con 0x7fed7414b7e0 2024-04-01T15:23:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.450+0000 7fed71600640 1 -- 172.21.15.142:0/702582345 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed6c019070 con 0x7fed7414b7e0 2024-04-01T15:23:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.450+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed74151d40 con 0x7fed7414b7e0 2024-04-01T15:23:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.450+0000 7fed71600640 1 -- 172.21.15.142:0/702582345 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c014800 con 0x7fed7414b7e0 2024-04-01T15:23:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.450+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed74138290 con 0x7fed7414b7e0 2024-04-01T15:23:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.451+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed74142320 con 0x7fed7414b7e0 2024-04-01T15:23:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.452+0000 7fed71600640 1 -- 172.21.15.142:0/702582345 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed6c0149a0 con 0x7fed7414b7e0 2024-04-01T15:23:51.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.453+0000 7fed71600640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fed5406c920 0x7fed5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.453+0000 7fed71600640 1 -- 172.21.15.142:0/702582345 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fed6c08c410 con 0x7fed7414b7e0 2024-04-01T15:23:51.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.453+0000 7fed71600640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7fed54074ca0 0x7fed54077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.453+0000 7fed71600640 1 -- 172.21.15.142:0/702582345 --> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed540777f0 con 0x7fed54074ca0 2024-04-01T15:23:51.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.453+0000 7fed71600640 1 -- 172.21.15.142:0/702582345 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fed6c093050 con 0x7fed7414b7e0 2024-04-01T15:23:51.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.454+0000 7fed79600640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fed5406c920 0x7fed5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.454+0000 7fed78c00640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7fed54074ca0 0x7fed54077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.454+0000 7fed78c00640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7fed54074ca0 0x7fed54077120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:51.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.455+0000 7fed79600640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fed5406c920 0x7fed5406ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed68035000 tx=0x7fed68008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:51.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.455+0000 7fed71600640 1 -- 172.21.15.142:0/702582345 <== osd.3 v2:172.21.15.142:6800/208376799 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed540777f0 con 0x7fed54074ca0 2024-04-01T15:23:51.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.470+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 --> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fed74068710 con 0x7fed54074ca0 2024-04-01T15:23:51.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.470+0000 7fed71600640 1 -- 172.21.15.142:0/702582345 <== osd.3 v2:172.21.15.142:6800/208376799 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fed74068710 con 0x7fed54074ca0 2024-04-01T15:23:51.472 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-01T15:23:51.472 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T15:23:51.472 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-01T15:23:51.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7fed54074ca0 msgr2=0x7fed54077120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.142:6800/208376799,v1:172.21.15.142:6801/208376799] conn(0x7fed54074ca0 0x7fed54077120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fed5406c920 msgr2=0x7fed5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fed5406c920 0x7fed5406ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed68035000 tx=0x7fed68008030 comp rx=0 tx=0).stop 2024-04-01T15:23:51.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed7414b7e0 msgr2=0x7fed74131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 --2- 172.21.15.142:0/702582345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed7414b7e0 0x7fed74131890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed6c007e90 tx=0x7fed6c00e4b0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7a000640 1 -- 172.21.15.142:0/702582345 reap_dead start 2024-04-01T15:23:51.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 shutdown_connections 2024-04-01T15:23:51.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 >> 172.21.15.142:0/702582345 conn(0x7fed740734b0 msgr2=0x7fed74067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:51.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 shutdown_connections 2024-04-01T15:23:51.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.471+0000 7fed7c000640 1 -- 172.21.15.142:0/702582345 wait complete. 2024-04-01T15:23:51.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-01T15:23:51.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.779+0000 7ff709200640 1 Processor -- start 2024-04-01T15:23:51.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.780+0000 7ff709200640 1 -- start start 2024-04-01T15:23:51.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.781+0000 7ff709200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7040af360 0x7ff70413e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.781+0000 7ff709200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7040b0590 con 0x7ff70413e7c0 2024-04-01T15:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.781+0000 7ff709200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7040aeea0 con 0x7ff7040b01b0 2024-04-01T15:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.781+0000 7ff709200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff7041447c0 con 0x7ff7040af360 2024-04-01T15:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.781+0000 7ff702800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff70413e7c0 0x7ff70414eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33028/0 (socket says 172.21.15.142:33028) 2024-04-01T15:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.781+0000 7ff702800640 1 -- 172.21.15.142:0/90453456 learned_addr learned my addr 172.21.15.142:0/90453456 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:51.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff701400640 1 --2- 172.21.15.142:0/90453456 >> v2:172.21.15.179:3300/0 conn(0x7ff7040af360 0x7ff70413e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215434861 0 0) 0x7ff7040b0590 con 0x7ff70413e7c0 2024-04-01T15:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6e4003520 con 0x7ff70413e7c0 2024-04-01T15:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1638014295 0 0) 0x7ff6e4003520 con 0x7ff70413e7c0 2024-04-01T15:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 >> v2:172.21.15.179:3300/0 conn(0x7ff7040af360 msgr2=0x7ff70413e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 --2- 172.21.15.142:0/90453456 >> v2:172.21.15.179:3300/0 conn(0x7ff7040af360 0x7ff70413e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 >> v1:172.21.15.179:6789/0 conn(0x7ff7040b01b0 legacy=0x7ff704144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff704144aa0 con 0x7ff70413e7c0 2024-04-01T15:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7ff6fc001670 con 0x7ff70413e7c0 2024-04-01T15:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 >> v1:172.21.15.142:6789/0 conn(0x7ff70413e7c0 legacy=0x7ff70414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e4003a00 0x7ff6e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6e4004800 0x7ff6e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6e40052e0 0x7ff6e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.782+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff7041447c0 con 0x7ff6e40052e0 2024-04-01T15:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e400c1e0 con 0x7ff6e4003a00 2024-04-01T15:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e400c3e0 con 0x7ff6e4004800 2024-04-01T15:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff702800640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6e40052e0 0x7ff6e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff701e00640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e4003a00 0x7ff6e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff701400640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6e4004800 0x7ff6e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff702800640 1 -- 172.21.15.142:0/90453456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6e4004800 msgr2=0x7ff6e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff702800640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6e4004800 0x7ff6e4004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff702800640 1 -- 172.21.15.142:0/90453456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e4003a00 msgr2=0x7ff6e4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff702800640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e4003a00 0x7ff6e4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.783+0000 7ff702800640 1 -- 172.21.15.142:0/90453456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e4003520 con 0x7ff6e40052e0 2024-04-01T15:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.784+0000 7ff702800640 1 -- 172.21.15.142:0/90453456 reap_dead start 2024-04-01T15:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.784+0000 7ff702800640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6e40052e0 0x7ff6e400b9c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c0e0 tx=0x7ff6e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fc8b40a4429538 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.784+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc007c20 con 0x7ff6e40052e0 2024-04-01T15:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.784+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc030070 con 0x7ff6e40052e0 2024-04-01T15:23:51.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.784+0000 7ff700a00640 1 -- 172.21.15.142:0/90453456 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc005d30 con 0x7ff6e40052e0 2024-04-01T15:23:51.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.785+0000 7ff709200640 1 -- 172.21.15.142:0/90453456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6e40052e0 msgr2=0x7ff6e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.785+0000 7ff709200640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6e40052e0 0x7ff6e400b9c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c0e0 tx=0x7ff6e4005830 comp rx=0 tx=0).stop 2024-04-01T15:23:51.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.785+0000 7ff709200640 1 -- 172.21.15.142:0/90453456 shutdown_connections 2024-04-01T15:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.785+0000 7ff709200640 1 --2- 172.21.15.142:0/90453456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6e40052e0 0x7ff6e400b9c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.785+0000 7ff709200640 1 -- 172.21.15.142:0/90453456 >> 172.21.15.142:0/90453456 conn(0x7ff7040b7d80 msgr2=0x7ff7040b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.785+0000 7ff709200640 1 -- 172.21.15.142:0/90453456 shutdown_connections 2024-04-01T15:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.785+0000 7ff709200640 1 -- 172.21.15.142:0/90453456 wait complete. 2024-04-01T15:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.787+0000 7ff709200640 1 Processor -- start 2024-04-01T15:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.787+0000 7ff709200640 1 -- start start 2024-04-01T15:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff709200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6e40052e0 0x7ff704072620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff709200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff70413f880 0x7ff7041e0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff709200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7041e0eb0 0x7ff704141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff709200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff7040afda0 con 0x7ff70413f880 2024-04-01T15:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff709200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7040afc20 con 0x7ff7041e0eb0 2024-04-01T15:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff709200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff70413ec70 con 0x7ff6e40052e0 2024-04-01T15:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff701400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff70413f880 0x7ff7041e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff701400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff70413f880 0x7ff7041e0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37952/0 (socket says 172.21.15.142:37952) 2024-04-01T15:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff701400640 1 -- 172.21.15.142:0/447709625 learned_addr learned my addr 172.21.15.142:0/447709625 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff701e00640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6e40052e0 0x7ff704072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff702800640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7041e0eb0 0x7ff704141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff701400640 1 -- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6e40052e0 msgr2=0x7ff704072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff701400640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6e40052e0 0x7ff704072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff701400640 1 -- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7041e0eb0 msgr2=0x7ff704141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff701400640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7041e0eb0 0x7ff704141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff701400640 1 -- 172.21.15.142:0/447709625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70413fdd0 con 0x7ff70413f880 2024-04-01T15:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.788+0000 7ff702800640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7041e0eb0 0x7ff704141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.789+0000 7ff701400640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff70413f880 0x7ff7041e0970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00f3b0 tx=0x7ff6ec00f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.789+0000 7ff6fa000640 1 -- 172.21.15.142:0/447709625 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec01c070 con 0x7ff70413f880 2024-04-01T15:23:51.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.789+0000 7ff6fa000640 1 -- 172.21.15.142:0/447709625 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ec017600 con 0x7ff70413f880 2024-04-01T15:23:51.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.789+0000 7ff6fa000640 1 -- 172.21.15.142:0/447709625 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0179f0 con 0x7ff70413f880 2024-04-01T15:23:51.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.789+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7040b4120 con 0x7ff70413f880 2024-04-01T15:23:51.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.789+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7041dcc90 con 0x7ff70413f880 2024-04-01T15:23:51.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.790+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff704068710 con 0x7ff70413f880 2024-04-01T15:23:51.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.791+0000 7ff6fa000640 1 -- 172.21.15.142:0/447709625 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff6ec01f070 con 0x7ff70413f880 2024-04-01T15:23:51.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.792+0000 7ff6fa000640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff6e006c8f0 0x7ff6e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:51.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.792+0000 7ff6fa000640 1 -- 172.21.15.142:0/447709625 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff6ec08bf60 con 0x7ff70413f880 2024-04-01T15:23:51.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.793+0000 7ff701e00640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff6e006c8f0 0x7ff6e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:51.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.794+0000 7ff701e00640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff6e006c8f0 0x7ff6e006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4001510 tx=0x7ff6f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:51.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.797+0000 7ff6fa000640 1 -- 172.21.15.142:0/447709625 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff6ec012070 con 0x7ff70413f880 2024-04-01T15:23:51.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.998+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ff7040af740 con 0x7ff6e006c8f0 2024-04-01T15:23:53.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:51.999+0000 7ff6fa000640 1 -- 172.21.15.142:0/447709625 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff7040af740 con 0x7ff6e006c8f0 2024-04-01T15:23:53.007 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 3 to deep-scrub 2024-04-01T15:23:53.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.001+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff6e006c8f0 msgr2=0x7ff6e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.001+0000 7ff709200640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff6e006c8f0 0x7ff6e006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4001510 tx=0x7ff6f4009040 comp rx=0 tx=0).stop 2024-04-01T15:23:53.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.001+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff70413f880 msgr2=0x7ff7041e0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.001+0000 7ff709200640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff70413f880 0x7ff7041e0970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00f3b0 tx=0x7ff6ec00f870 comp rx=0 tx=0).stop 2024-04-01T15:23:53.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.002+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 shutdown_connections 2024-04-01T15:23:53.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.002+0000 7ff709200640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff6e006c8f0 0x7ff6e006edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.002+0000 7ff709200640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7041e0eb0 0x7ff704141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.002+0000 7ff709200640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff70413f880 0x7ff7041e0970 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.002+0000 7ff709200640 1 --2- 172.21.15.142:0/447709625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6e40052e0 0x7ff704072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.002+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 >> 172.21.15.142:0/447709625 conn(0x7ff7040b7d80 msgr2=0x7ff7040b89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:53.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.002+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 shutdown_connections 2024-04-01T15:23:53.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:52.002+0000 7ff709200640 1 -- 172.21.15.142:0/447709625 wait complete. 2024-04-01T15:23:53.009 INFO:tasks.ceph:Scrubbing osd.4 2024-04-01T15:23:53.009 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-01T15:23:53.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.233+0000 7fcb82000640 1 Processor -- start 2024-04-01T15:23:53.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.233+0000 7fcb82000640 1 -- start start 2024-04-01T15:23:53.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.234+0000 7fcb82000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb7c14ee60 0x7fcb7c151250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.234+0000 7fcb82000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb7c0b3180 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.234+0000 7fcb82000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb7c06dcb0 con 0x7fcb7c0b2d20 2024-04-01T15:23:53.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.234+0000 7fcb82000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7c0b0b20 con 0x7fcb7c14ee60 2024-04-01T15:23:53.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.234+0000 7fcb7b400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcb7c06d8d0 0x7fcb7c0b0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33038/0 (socket says 172.21.15.142:33038) 2024-04-01T15:23:53.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.234+0000 7fcb7b400640 1 -- 172.21.15.142:0/2772871916 learned_addr learned my addr 172.21.15.142:0/2772871916 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:53.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.234+0000 7fcb7be00640 1 --2- 172.21.15.142:0/2772871916 >> v2:172.21.15.142:3300/0 conn(0x7fcb7c14ee60 0x7fcb7c151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.235+0000 7fcb7aa00640 1 -- 172.21.15.142:0/2772871916 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065396740 0 0) 0x7fcb7c0b3180 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.235+0000 7fcb7aa00640 1 -- 172.21.15.142:0/2772871916 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb60003520 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.235+0000 7fcb7be00640 1 -- 172.21.15.142:0/2772871916 >> v1:172.21.15.179:6789/0 conn(0x7fcb7c0b2d20 legacy=0x7fcb7c1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:53.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.235+0000 7fcb7be00640 1 -- 172.21.15.142:0/2772871916 >> v1:172.21.15.142:6789/0 conn(0x7fcb7c06d8d0 legacy=0x7fcb7c0b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.235+0000 7fcb7be00640 1 -- 172.21.15.142:0/2772871916 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c148ad0 con 0x7fcb7c14ee60 2024-04-01T15:23:53.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.236+0000 7fcb7be00640 1 --2- 172.21.15.142:0/2772871916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c14ee60 0x7fcb7c151250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009d90 tx=0x7fcb7402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d4f7fb0c76cd2d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.236+0000 7fcb7aa00640 1 -- 172.21.15.142:0/2772871916 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74039070 con 0x7fcb7c14ee60 2024-04-01T15:23:53.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.236+0000 7fcb7aa00640 1 -- 172.21.15.142:0/2772871916 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7402cd00 con 0x7fcb7c14ee60 2024-04-01T15:23:53.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.236+0000 7fcb7aa00640 1 -- 172.21.15.142:0/2772871916 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74034640 con 0x7fcb7c14ee60 2024-04-01T15:23:53.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.237+0000 7fcb82000640 1 -- 172.21.15.142:0/2772871916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c14ee60 msgr2=0x7fcb7c151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.237+0000 7fcb82000640 1 --2- 172.21.15.142:0/2772871916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c14ee60 0x7fcb7c151250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009d90 tx=0x7fcb7402bf50 comp rx=0 tx=0).stop 2024-04-01T15:23:53.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.237+0000 7fcb82000640 1 -- 172.21.15.142:0/2772871916 shutdown_connections 2024-04-01T15:23:53.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.237+0000 7fcb82000640 1 --2- 172.21.15.142:0/2772871916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c14ee60 0x7fcb7c151250 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.237+0000 7fcb82000640 1 -- 172.21.15.142:0/2772871916 >> 172.21.15.142:0/2772871916 conn(0x7fcb7c0b5890 msgr2=0x7fcb7c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:53.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.237+0000 7fcb82000640 1 -- 172.21.15.142:0/2772871916 shutdown_connections 2024-04-01T15:23:53.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.237+0000 7fcb82000640 1 -- 172.21.15.142:0/2772871916 wait complete. 2024-04-01T15:23:53.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.238+0000 7fcb82000640 1 Processor -- start 2024-04-01T15:23:53.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.239+0000 7fcb82000640 1 -- start start 2024-04-01T15:23:53.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.239+0000 7fcb82000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c06d8d0 0x7fcb7c13afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.239+0000 7fcb82000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0b2d20 0x7fcb7c1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.239+0000 7fcb82000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c14ee60 0x7fcb7c1361b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.239+0000 7fcb82000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0b16c0 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.239+0000 7fcb82000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0b5510 con 0x7fcb7c14ee60 2024-04-01T15:23:53.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.239+0000 7fcb82000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7c1498f0 con 0x7fcb7c0b2d20 2024-04-01T15:23:53.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c06d8d0 0x7fcb7c13afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c06d8d0 0x7fcb7c13afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37974/0 (socket says 172.21.15.142:37974) 2024-04-01T15:23:53.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7b400640 1 -- 172.21.15.142:0/2492496820 learned_addr learned my addr 172.21.15.142:0/2492496820 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:53.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7b400640 1 -- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0b2d20 msgr2=0x7fcb7c1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb72a00640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0b2d20 0x7fcb7c1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7be00640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c14ee60 0x7fcb7c1361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7b400640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0b2d20 0x7fcb7c1466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7b400640 1 -- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c14ee60 msgr2=0x7fcb7c1361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7b400640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c14ee60 0x7fcb7c1361b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7b400640 1 -- 172.21.15.142:0/2492496820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c13d030 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb72a00640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0b2d20 0x7fcb7c1466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:53.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.240+0000 7fcb7b400640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c06d8d0 0x7fcb7c13afd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00c4d0 tx=0x7fcb6c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.241+0000 7fcb73e00640 1 -- 172.21.15.142:0/2492496820 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c017070 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.241+0000 7fcb73e00640 1 -- 172.21.15.142:0/2492496820 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c005ce0 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.241+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c13d310 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.241+0000 7fcb73e00640 1 -- 172.21.15.142:0/2492496820 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c007270 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.241+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c146be0 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.242+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb7c13ce70 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.243+0000 7fcb73e00640 1 -- 172.21.15.142:0/2492496820 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb6c01a070 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.244+0000 7fcb73e00640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb5806c8f0 0x7fcb5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.244+0000 7fcb73e00640 1 -- 172.21.15.142:0/2492496820 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fcb6c08ae90 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.244+0000 7fcb73e00640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fcb58074c70 0x7fcb580770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.244+0000 7fcb73e00640 1 -- 172.21.15.142:0/2492496820 --> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb580777c0 con 0x7fcb58074c70 2024-04-01T15:23:53.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.244+0000 7fcb73e00640 1 -- 172.21.15.142:0/2492496820 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fcb6c08d4b0 con 0x7fcb7c06d8d0 2024-04-01T15:23:53.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.244+0000 7fcb72a00640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb5806c8f0 0x7fcb5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.245+0000 7fcb7be00640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fcb58074c70 0x7fcb580770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.246+0000 7fcb72a00640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb5806c8f0 0x7fcb5806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c148a40 tx=0x7fcb64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.246+0000 7fcb7be00640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fcb58074c70 0x7fcb580770f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.248+0000 7fcb73e00640 1 -- 172.21.15.142:0/2492496820 <== osd.4 v2:172.21.15.179:6816/934337813 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb580777c0 con 0x7fcb58074c70 2024-04-01T15:23:53.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.262+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 --> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcb7c0b4a90 con 0x7fcb58074c70 2024-04-01T15:23:53.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.263+0000 7fcb73e00640 1 -- 172.21.15.142:0/2492496820 <== osd.4 v2:172.21.15.179:6816/934337813 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcb7c0b4a90 con 0x7fcb58074c70 2024-04-01T15:23:53.265 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-01T15:23:53.265 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T15:23:53.265 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-01T15:23:53.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.264+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fcb58074c70 msgr2=0x7fcb580770f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.264+0000 7fcb82000640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6816/934337813,v1:172.21.15.179:6818/934337813] conn(0x7fcb58074c70 0x7fcb580770f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.264+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb5806c8f0 msgr2=0x7fcb5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.264+0000 7fcb82000640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fcb5806c8f0 0x7fcb5806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c148a40 tx=0x7fcb64009040 comp rx=0 tx=0).stop 2024-04-01T15:23:53.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.264+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c06d8d0 msgr2=0x7fcb7c13afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.264+0000 7fcb82000640 1 --2- 172.21.15.142:0/2492496820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c06d8d0 0x7fcb7c13afd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00c4d0 tx=0x7fcb6c00c990 comp rx=0 tx=0).stop 2024-04-01T15:23:53.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.264+0000 7fcb7be00640 1 -- 172.21.15.142:0/2492496820 reap_dead start 2024-04-01T15:23:53.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.264+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 shutdown_connections 2024-04-01T15:23:53.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.264+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 >> 172.21.15.142:0/2492496820 conn(0x7fcb7c0b5890 msgr2=0x7fcb7c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:53.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.265+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 shutdown_connections 2024-04-01T15:23:53.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.265+0000 7fcb82000640 1 -- 172.21.15.142:0/2492496820 wait complete. 2024-04-01T15:23:53.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-01T15:23:53.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.498+0000 7ff0ade00640 1 Processor -- start 2024-04-01T15:23:53.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.498+0000 7ff0ade00640 1 -- start start 2024-04-01T15:23:53.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0ade00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0a809f080 0x7ff0a80b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0ade00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a809f460 con 0x7ff0a81416d0 2024-04-01T15:23:53.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0ade00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a80b4a90 con 0x7ff0a814b440 2024-04-01T15:23:53.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0ade00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a80b6240 con 0x7ff0a809f080 2024-04-01T15:23:53.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0a6000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff0a81416d0 0x7ff0a814ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33048/0 (socket says 172.21.15.142:33048) 2024-04-01T15:23:53.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0a6000640 1 -- 172.21.15.142:0/2521596678 learned_addr learned my addr 172.21.15.142:0/2521596678 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:53.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0a6a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0a809f080 0x7ff0a80b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0a5600640 1 -- 172.21.15.142:0/2521596678 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37489765 0 0) 0x7ff0a809f460 con 0x7ff0a81416d0 2024-04-01T15:23:53.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0a6a00640 1 -- 172.21.15.142:0/2521596678 >> v1:172.21.15.179:6789/0 conn(0x7ff0a814b440 legacy=0x7ff0a8152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:53.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0a6a00640 1 -- 172.21.15.142:0/2521596678 >> v1:172.21.15.142:6789/0 conn(0x7ff0a81416d0 legacy=0x7ff0a814ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.500+0000 7ff0a6a00640 1 -- 172.21.15.142:0/2521596678 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a80b4d70 con 0x7ff0a809f080 2024-04-01T15:23:53.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.502+0000 7ff0a6a00640 1 --2- 172.21.15.142:0/2521596678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a809f080 0x7ff0a80b5b20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff0980097a0 tx=0x7ff09802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8672f72bb357f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.502+0000 7ff0a5600640 1 -- 172.21.15.142:0/2521596678 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0980315a0 con 0x7ff0a809f080 2024-04-01T15:23:53.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.502+0000 7ff0a5600640 1 -- 172.21.15.142:0/2521596678 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff098037070 con 0x7ff0a809f080 2024-04-01T15:23:53.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.502+0000 7ff0a5600640 1 -- 172.21.15.142:0/2521596678 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098031960 con 0x7ff0a809f080 2024-04-01T15:23:53.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.502+0000 7ff0ade00640 1 -- 172.21.15.142:0/2521596678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a809f080 msgr2=0x7ff0a80b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.502+0000 7ff0ade00640 1 --2- 172.21.15.142:0/2521596678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a809f080 0x7ff0a80b5b20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff0980097a0 tx=0x7ff09802b840 comp rx=0 tx=0).stop 2024-04-01T15:23:53.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.503+0000 7ff0ade00640 1 -- 172.21.15.142:0/2521596678 shutdown_connections 2024-04-01T15:23:53.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.503+0000 7ff0ade00640 1 --2- 172.21.15.142:0/2521596678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a809f080 0x7ff0a80b5b20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.503+0000 7ff0ade00640 1 -- 172.21.15.142:0/2521596678 >> 172.21.15.142:0/2521596678 conn(0x7ff0a80b9ef0 msgr2=0x7ff0a80ba300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:53.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.503+0000 7ff0ade00640 1 -- 172.21.15.142:0/2521596678 shutdown_connections 2024-04-01T15:23:53.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.503+0000 7ff0ade00640 1 -- 172.21.15.142:0/2521596678 wait complete. 2024-04-01T15:23:53.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.504+0000 7ff0ade00640 1 Processor -- start 2024-04-01T15:23:53.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.504+0000 7ff0ade00640 1 -- start start 2024-04-01T15:23:53.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.505+0000 7ff0ade00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0a809f080 0x7ff0a80b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.505+0000 7ff0ade00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0a81416d0 0x7ff0a81dd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.505+0000 7ff0ade00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a80b23c0 0x7ff0a81dddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.505+0000 7ff0ade00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80b67b0 con 0x7ff0a80b23c0 2024-04-01T15:23:53.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.505+0000 7ff0ade00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80b6630 con 0x7ff0a81416d0 2024-04-01T15:23:53.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.505+0000 7ff0ade00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a8141b50 con 0x7ff0a809f080 2024-04-01T15:23:53.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.505+0000 7ff0a7400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a80b23c0 0x7ff0a81dddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.505+0000 7ff0a7400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a80b23c0 0x7ff0a81dddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38000/0 (socket says 172.21.15.142:38000) 2024-04-01T15:23:53.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.505+0000 7ff0a7400640 1 -- 172.21.15.142:0/1653696055 learned_addr learned my addr 172.21.15.142:0/1653696055 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:53.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a6000640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0a81416d0 0x7ff0a81dd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a6a00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0a809f080 0x7ff0a80b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a7400640 1 -- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0a809f080 msgr2=0x7ff0a80b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a7400640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0a809f080 0x7ff0a80b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a7400640 1 -- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0a81416d0 msgr2=0x7ff0a81dd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a7400640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0a81416d0 0x7ff0a81dd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a7400640 1 -- 172.21.15.142:0/1653696055 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a80b3ab0 con 0x7ff0a80b23c0 2024-04-01T15:23:53.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a6000640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0a81416d0 0x7ff0a81dd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:53.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a6a00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0a809f080 0x7ff0a80b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:53.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0a7400640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a80b23c0 0x7ff0a81dddc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000b970 tx=0x7ff0a000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff09f400640 1 -- 172.21.15.142:0/1653696055 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0019070 con 0x7ff0a80b23c0 2024-04-01T15:23:53.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff09f400640 1 -- 172.21.15.142:0/1653696055 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a000cb40 con 0x7ff0a80b23c0 2024-04-01T15:23:53.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff09f400640 1 -- 172.21.15.142:0/1653696055 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0014440 con 0x7ff0a80b23c0 2024-04-01T15:23:53.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a80b2880 con 0x7ff0a80b23c0 2024-04-01T15:23:53.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.506+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a8140300 con 0x7ff0a80b23c0 2024-04-01T15:23:53.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.508+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a8068710 con 0x7ff0a80b23c0 2024-04-01T15:23:53.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.509+0000 7ff09f400640 1 -- 172.21.15.142:0/1653696055 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0a001c070 con 0x7ff0a80b23c0 2024-04-01T15:23:53.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.509+0000 7ff09f400640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff08406c8f0 0x7ff08406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.510+0000 7ff09f400640 1 -- 172.21.15.142:0/1653696055 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff0a008b720 con 0x7ff0a80b23c0 2024-04-01T15:23:53.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.510+0000 7ff0a6a00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff08406c8f0 0x7ff08406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.511+0000 7ff0a6a00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff08406c8f0 0x7ff08406edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff098036000 tx=0x7ff098008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.514+0000 7ff09f400640 1 -- 172.21.15.142:0/1653696055 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff0a0059b60 con 0x7ff0a80b23c0 2024-04-01T15:23:53.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.718+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff0a814ac50 con 0x7ff08406c8f0 2024-04-01T15:23:53.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.719+0000 7ff09f400640 1 -- 172.21.15.142:0/1653696055 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff0a814ac50 con 0x7ff08406c8f0 2024-04-01T15:23:53.721 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 4 to deep-scrub 2024-04-01T15:23:53.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff08406c8f0 msgr2=0x7ff08406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff08406c8f0 0x7ff08406edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff098036000 tx=0x7ff098008030 comp rx=0 tx=0).stop 2024-04-01T15:23:53.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a80b23c0 msgr2=0x7ff0a81dddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a80b23c0 0x7ff0a81dddc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000b970 tx=0x7ff0a000be30 comp rx=0 tx=0).stop 2024-04-01T15:23:53.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 shutdown_connections 2024-04-01T15:23:53.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff08406c8f0 0x7ff08406edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a80b23c0 0x7ff0a81dddc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0a81416d0 0x7ff0a81dd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 --2- 172.21.15.142:0/1653696055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0a809f080 0x7ff0a80b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 >> 172.21.15.142:0/1653696055 conn(0x7ff0a80b9ef0 msgr2=0x7ff0a80b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:53.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 shutdown_connections 2024-04-01T15:23:53.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.722+0000 7ff0ade00640 1 -- 172.21.15.142:0/1653696055 wait complete. 2024-04-01T15:23:53.742 INFO:tasks.ceph:Scrubbing osd.5 2024-04-01T15:23:53.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-01T15:23:53.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.959+0000 7f3360a00640 1 Processor -- start 2024-04-01T15:23:53.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.960+0000 7f3360a00640 1 -- start start 2024-04-01T15:23:53.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.961+0000 7f3360a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f335c0b22a0 0x7f335c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.961+0000 7f3360a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f335c0b55a0 con 0x7f335c0afae0 2024-04-01T15:23:53.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.961+0000 7f3360a00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f335c0b0430 con 0x7f335c0b51c0 2024-04-01T15:23:53.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.961+0000 7f3360a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f335c0ae8c0 con 0x7f335c0b22a0 2024-04-01T15:23:53.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.961+0000 7f335a800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f335c0b22a0 0x7f335c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.961+0000 7f3351400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f335c0afae0 0x7f335c1501b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33050/0 (socket says 172.21.15.142:33050) 2024-04-01T15:23:53.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.961+0000 7f3351400640 1 -- 172.21.15.142:0/3855775654 learned_addr learned my addr 172.21.15.142:0/3855775654 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:53.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.962+0000 7f335a800640 1 -- 172.21.15.142:0/3855775654 >> v1:172.21.15.179:6789/0 conn(0x7f335c0b51c0 legacy=0x7f335c0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:53.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.962+0000 7f335a800640 1 -- 172.21.15.142:0/3855775654 >> v1:172.21.15.142:6789/0 conn(0x7f335c0afae0 legacy=0x7f335c1501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.962+0000 7f335a800640 1 -- 172.21.15.142:0/3855775654 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c06db20 con 0x7f335c0b22a0 2024-04-01T15:23:53.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.963+0000 7f335a800640 1 --2- 172.21.15.142:0/3855775654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b22a0 0x7f335c14ae90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f33540097a0 tx=0x7f335402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fef757c8458b89c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.967+0000 7f3359400640 1 -- 172.21.15.142:0/3855775654 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354038070 con 0x7f335c0b22a0 2024-04-01T15:23:53.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.967+0000 7f3359400640 1 -- 172.21.15.142:0/3855775654 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3354031700 con 0x7f335c0b22a0 2024-04-01T15:23:53.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.967+0000 7f3359400640 1 -- 172.21.15.142:0/3855775654 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354031ad0 con 0x7f335c0b22a0 2024-04-01T15:23:53.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.968+0000 7f3360a00640 1 -- 172.21.15.142:0/3855775654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b22a0 msgr2=0x7f335c14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.968+0000 7f3360a00640 1 --2- 172.21.15.142:0/3855775654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b22a0 0x7f335c14ae90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f33540097a0 tx=0x7f335402b7a0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.968+0000 7f3360a00640 1 -- 172.21.15.142:0/3855775654 shutdown_connections 2024-04-01T15:23:53.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.968+0000 7f3360a00640 1 --2- 172.21.15.142:0/3855775654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b22a0 0x7f335c14ae90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.968+0000 7f3360a00640 1 -- 172.21.15.142:0/3855775654 >> 172.21.15.142:0/3855775654 conn(0x7f335c0b5890 msgr2=0x7f335c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:53.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.968+0000 7f3360a00640 1 -- 172.21.15.142:0/3855775654 shutdown_connections 2024-04-01T15:23:53.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.968+0000 7f3360a00640 1 -- 172.21.15.142:0/3855775654 wait complete. 2024-04-01T15:23:53.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.969+0000 7f3360a00640 1 Processor -- start 2024-04-01T15:23:53.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.970+0000 7f3360a00640 1 -- start start 2024-04-01T15:23:53.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.970+0000 7f3360a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f335c0b22a0 0x7f335c1dcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.970+0000 7f3360a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b51c0 0x7f335c1417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.970+0000 7f3360a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f335c1e1120 0x7f335c070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.970+0000 7f3360a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f335c0ae2f0 con 0x7f335c0b51c0 2024-04-01T15:23:53.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.970+0000 7f3360a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f335c0ae170 con 0x7f335c1e1120 2024-04-01T15:23:53.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.970+0000 7f3360a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f335c0aede0 con 0x7f335c0b22a0 2024-04-01T15:23:53.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3351400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b51c0 0x7f335c1417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3351400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b51c0 0x7f335c1417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38024/0 (socket says 172.21.15.142:38024) 2024-04-01T15:23:53.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3351400640 1 -- 172.21.15.142:0/135716032 learned_addr learned my addr 172.21.15.142:0/135716032 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:53.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3359e00640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f335c0b22a0 0x7f335c1dcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f335a800640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f335c1e1120 0x7f335c070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3351400640 1 -- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f335c0b22a0 msgr2=0x7f335c1dcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3351400640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f335c0b22a0 0x7f335c1dcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3351400640 1 -- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f335c1e1120 msgr2=0x7f335c070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3351400640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f335c1e1120 0x7f335c070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3351400640 1 -- 172.21.15.142:0/135716032 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c072530 con 0x7f335c0b51c0 2024-04-01T15:23:53.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.971+0000 7f3351400640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b51c0 0x7f335c1417f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f334400c3d0 tx=0x7f334400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.972+0000 7f3352a00640 1 -- 172.21.15.142:0/135716032 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3344017070 con 0x7f335c0b51c0 2024-04-01T15:23:53.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.972+0000 7f3352a00640 1 -- 172.21.15.142:0/135716032 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3344005ce0 con 0x7f335c0b51c0 2024-04-01T15:23:53.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.972+0000 7f3352a00640 1 -- 172.21.15.142:0/135716032 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33440072f0 con 0x7f335c0b51c0 2024-04-01T15:23:53.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.972+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335c1441b0 con 0x7f335c0b51c0 2024-04-01T15:23:53.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.972+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335c1e0920 con 0x7f335c0b51c0 2024-04-01T15:23:53.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.973+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f335c068710 con 0x7f335c0b51c0 2024-04-01T15:23:53.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.974+0000 7f3352a00640 1 -- 172.21.15.142:0/135716032 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f334401a070 con 0x7f335c0b51c0 2024-04-01T15:23:53.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.975+0000 7f3352a00640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f333806c8f0 0x7f333806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.975+0000 7f3352a00640 1 -- 172.21.15.142:0/135716032 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f334408afb0 con 0x7f335c0b51c0 2024-04-01T15:23:53.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.975+0000 7f3352a00640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3338074c10 0x7f3338077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:53.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.975+0000 7f3352a00640 1 -- 172.21.15.142:0/135716032 --> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3344015e70 con 0x7f3338074c10 2024-04-01T15:23:53.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.975+0000 7f3352a00640 1 -- 172.21.15.142:0/135716032 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f334408d5d0 con 0x7f335c0b51c0 2024-04-01T15:23:53.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.975+0000 7f3359e00640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f333806c8f0 0x7f333806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.976+0000 7f335a800640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3338074c10 0x7f3338077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.977+0000 7f335a800640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3338074c10 0x7f3338077090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.977+0000 7f3359e00640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f333806c8f0 0x7f333806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f335c13e4b0 tx=0x7f334c0094d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:53.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.979+0000 7f3352a00640 1 -- 172.21.15.142:0/135716032 <== osd.5 v2:172.21.15.179:6817/1223314628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3344015e70 con 0x7f3338074c10 2024-04-01T15:23:53.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.993+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 --> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f335c14b5a0 con 0x7f3338074c10 2024-04-01T15:23:53.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.994+0000 7f3352a00640 1 -- 172.21.15.142:0/135716032 <== osd.5 v2:172.21.15.179:6817/1223314628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f335c14b5a0 con 0x7f3338074c10 2024-04-01T15:23:53.995 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-01T15:23:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T15:23:53.996 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-01T15:23:53.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.994+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3338074c10 msgr2=0x7f3338077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.994+0000 7f3360a00640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6817/1223314628,v1:172.21.15.179:6819/1223314628] conn(0x7f3338074c10 0x7f3338077090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.995+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f333806c8f0 msgr2=0x7f333806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.995+0000 7f3360a00640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f333806c8f0 0x7f333806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f335c13e4b0 tx=0x7f334c0094d0 comp rx=0 tx=0).stop 2024-04-01T15:23:53.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.995+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b51c0 msgr2=0x7f335c1417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:53.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.995+0000 7f3360a00640 1 --2- 172.21.15.142:0/135716032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335c0b51c0 0x7f335c1417f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f334400c3d0 tx=0x7f334400c890 comp rx=0 tx=0).stop 2024-04-01T15:23:53.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.995+0000 7f335a800640 1 -- 172.21.15.142:0/135716032 reap_dead start 2024-04-01T15:23:53.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.995+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 shutdown_connections 2024-04-01T15:23:53.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.995+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 >> 172.21.15.142:0/135716032 conn(0x7f335c0b5890 msgr2=0x7f335c0b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:53.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.995+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 shutdown_connections 2024-04-01T15:23:53.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:53.995+0000 7f3360a00640 1 -- 172.21.15.142:0/135716032 wait complete. 2024-04-01T15:23:54.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-01T15:23:54.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.220+0000 7f5c8f200640 1 Processor -- start 2024-04-01T15:23:54.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.220+0000 7f5c8f200640 1 -- start start 2024-04-01T15:23:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.221+0000 7f5c8f200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5c88147e40 0x7f5c881417d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.221+0000 7f5c8f200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c880ba660 con 0x7f5c880ba280 2024-04-01T15:23:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.221+0000 7f5c8f200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c880b4420 con 0x7f5c88141390 2024-04-01T15:23:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.221+0000 7f5c8f200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f5c880b4700 con 0x7f5c88147e40 2024-04-01T15:23:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8de00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5c880ba280 0x7f5c880b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33058/0 (socket says 172.21.15.142:33058) 2024-04-01T15:23:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8de00640 1 -- 172.21.15.142:0/314463638 learned_addr learned my addr 172.21.15.142:0/314463638 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8e800640 1 --2- 172.21.15.142:0/314463638 >> v2:172.21.15.179:3300/0 conn(0x7f5c88147e40 0x7f5c881417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4114450593 0 0) 0x7f5c880ba660 con 0x7f5c880ba280 2024-04-01T15:23:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c70003520 con 0x7f5c880ba280 2024-04-01T15:23:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3138226657 0 0) 0x7f5c70003520 con 0x7f5c880ba280 2024-04-01T15:23:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 >> v2:172.21.15.179:3300/0 conn(0x7f5c88147e40 msgr2=0x7f5c881417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8ca00640 1 --2- 172.21.15.142:0/314463638 >> v2:172.21.15.179:3300/0 conn(0x7f5c88147e40 0x7f5c881417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 >> v1:172.21.15.179:6789/0 conn(0x7f5c88141390 legacy=0x7f5c88147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c880b49e0 con 0x7f5c880ba280 2024-04-01T15:23:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f5c7c001670 con 0x7f5c880ba280 2024-04-01T15:23:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.222+0000 7f5c8e800640 1 --2- 172.21.15.142:0/314463638 >> v2:172.21.15.179:3300/0 conn(0x7f5c88147e40 0x7f5c881417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:23:54.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 >> v1:172.21.15.142:6789/0 conn(0x7f5c880ba280 legacy=0x7f5c880b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8ca00640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c70003a00 0x7f5c70003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8ca00640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c70004800 0x7f5c70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8ca00640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c70005210 0x7f5c7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5c880b4700 con 0x7f5c70003a00 2024-04-01T15:23:54.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7000c160 con 0x7f5c70004800 2024-04-01T15:23:54.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5c7000c360 con 0x7f5c70005210 2024-04-01T15:23:54.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8de00640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c70003a00 0x7f5c70003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8d400640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c70004800 0x7f5c70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8e800640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c70005210 0x7f5c7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8de00640 1 -- 172.21.15.142:0/314463638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c70005210 msgr2=0x7f5c7000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:54.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8de00640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c70005210 0x7f5c7000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8de00640 1 -- 172.21.15.142:0/314463638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c70004800 msgr2=0x7f5c70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:54.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8de00640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c70004800 0x7f5c70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8de00640 1 -- 172.21.15.142:0/314463638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c70003520 con 0x7f5c70003a00 2024-04-01T15:23:54.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.223+0000 7f5c8e800640 1 -- 172.21.15.142:0/314463638 reap_dead start 2024-04-01T15:23:54.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.224+0000 7f5c8de00640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c70003a00 0x7f5c70003e20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00c110 tx=0x7f5c70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d91889fc4fc20b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c007c40 con 0x7f5c70003a00 2024-04-01T15:23:54.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7c030070 con 0x7f5c70003a00 2024-04-01T15:23:54.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8ca00640 1 -- 172.21.15.142:0/314463638 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c005d70 con 0x7f5c70003a00 2024-04-01T15:23:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8f200640 1 -- 172.21.15.142:0/314463638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c70003a00 msgr2=0x7f5c70003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8f200640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c70003a00 0x7f5c70003e20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00c110 tx=0x7f5c70005830 comp rx=0 tx=0).stop 2024-04-01T15:23:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8f200640 1 -- 172.21.15.142:0/314463638 shutdown_connections 2024-04-01T15:23:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8f200640 1 --2- 172.21.15.142:0/314463638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c70003a00 0x7f5c70003e20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8f200640 1 -- 172.21.15.142:0/314463638 >> 172.21.15.142:0/314463638 conn(0x7f5c880bd4b0 msgr2=0x7f5c880b9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8f200640 1 -- 172.21.15.142:0/314463638 shutdown_connections 2024-04-01T15:23:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.225+0000 7f5c8f200640 1 -- 172.21.15.142:0/314463638 wait complete. 2024-04-01T15:23:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.227+0000 7f5c8f200640 1 Processor -- start 2024-04-01T15:23:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.227+0000 7f5c8f200640 1 -- start start 2024-04-01T15:23:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8f200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c70003a00 0x7f5c881e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8f200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c88142ca0 0x7f5c88143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c881ce600 0x7f5c881ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5c88141950 con 0x7f5c881ce600 2024-04-01T15:23:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8f200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5c881417d0 con 0x7f5c88142ca0 2024-04-01T15:23:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8f200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5c88141ad0 con 0x7f5c70003a00 2024-04-01T15:23:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8e800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c881ce600 0x7f5c881ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8e800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c881ce600 0x7f5c881ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38034/0 (socket says 172.21.15.142:38034) 2024-04-01T15:23:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8e800640 1 -- 172.21.15.142:0/3766701300 learned_addr learned my addr 172.21.15.142:0/3766701300 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8de00640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c70003a00 0x7f5c881e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.228+0000 7f5c8d400640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c88142ca0 0x7f5c88143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c8e800640 1 -- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c70003a00 msgr2=0x7f5c881e0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c8e800640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c70003a00 0x7f5c881e0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c8e800640 1 -- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c88142ca0 msgr2=0x7f5c88143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c8e800640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c88142ca0 0x7f5c88143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c8e800640 1 -- 172.21.15.142:0/3766701300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c881d0010 con 0x7f5c881ce600 2024-04-01T15:23:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c8e800640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c881ce600 0x7f5c881ceab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5c880b6db0 tx=0x7f5c84004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c82000640 1 -- 172.21.15.142:0/3766701300 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84007d30 con 0x7f5c881ce600 2024-04-01T15:23:54.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c82000640 1 -- 172.21.15.142:0/3766701300 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c84019070 con 0x7f5c881ce600 2024-04-01T15:23:54.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c881e17b0 con 0x7f5c881ce600 2024-04-01T15:23:54.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c82000640 1 -- 172.21.15.142:0/3766701300 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84014630 con 0x7f5c881ce600 2024-04-01T15:23:54.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.229+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c881427a0 con 0x7f5c881ce600 2024-04-01T15:23:54.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.231+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c88068590 con 0x7f5c881ce600 2024-04-01T15:23:54.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.231+0000 7f5c82000640 1 -- 172.21.15.142:0/3766701300 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c840147d0 con 0x7f5c881ce600 2024-04-01T15:23:54.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.233+0000 7f5c82000640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5c6c06c8f0 0x7f5c6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.233+0000 7f5c82000640 1 -- 172.21.15.142:0/3766701300 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5c8408c210 con 0x7f5c881ce600 2024-04-01T15:23:54.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.233+0000 7f5c8de00640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5c6c06c8f0 0x7f5c6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.234+0000 7f5c8de00640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5c6c06c8f0 0x7f5c6c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c034000 tx=0x7f5c7c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.238+0000 7f5c82000640 1 -- 172.21.15.142:0/3766701300 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5c84023020 con 0x7f5c881ce600 2024-04-01T15:23:54.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.436+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f5c880b5cf0 con 0x7f5c6c06c8f0 2024-04-01T15:23:54.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.438+0000 7f5c82000640 1 -- 172.21.15.142:0/3766701300 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5c880b5cf0 con 0x7f5c6c06c8f0 2024-04-01T15:23:54.439 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 5 to deep-scrub 2024-04-01T15:23:54.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5c6c06c8f0 msgr2=0x7f5c6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5c6c06c8f0 0x7f5c6c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c034000 tx=0x7f5c7c009030 comp rx=0 tx=0).stop 2024-04-01T15:23:54.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c881ce600 msgr2=0x7f5c881ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c881ce600 0x7f5c881ceab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5c880b6db0 tx=0x7f5c84004840 comp rx=0 tx=0).stop 2024-04-01T15:23:54.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 shutdown_connections 2024-04-01T15:23:54.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f5c6c06c8f0 0x7f5c6c06edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c881ce600 0x7f5c881ceab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c88142ca0 0x7f5c88143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 --2- 172.21.15.142:0/3766701300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c70003a00 0x7f5c881e0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.440+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 >> 172.21.15.142:0/3766701300 conn(0x7f5c880bd4b0 msgr2=0x7f5c880b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:54.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.441+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 shutdown_connections 2024-04-01T15:23:54.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.441+0000 7f5c8f200640 1 -- 172.21.15.142:0/3766701300 wait complete. 2024-04-01T15:23:54.461 INFO:tasks.ceph:Scrubbing osd.6 2024-04-01T15:23:54.461 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-01T15:23:54.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.671+0000 7f0162200640 1 Processor -- start 2024-04-01T15:23:54.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.672+0000 7f0162200640 1 -- start start 2024-04-01T15:23:54.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.673+0000 7f0162200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f015c0b20f0 0x7f015c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.673+0000 7f0162200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f015c0b12e0 con 0x7f015c0af060 2024-04-01T15:23:54.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.673+0000 7f0162200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f015c0b4df0 con 0x7f015c06d740 2024-04-01T15:23:54.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.673+0000 7f0162200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f015c0b55b0 con 0x7f015c0b20f0 2024-04-01T15:23:54.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.673+0000 7f0161800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f015c0b20f0 0x7f015c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.673+0000 7f0153e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f015c0af060 0x7f015c0b19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33062/0 (socket says 172.21.15.142:33062) 2024-04-01T15:23:54.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.673+0000 7f0153e00640 1 -- 172.21.15.142:0/1486650408 learned_addr learned my addr 172.21.15.142:0/1486650408 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:54.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.674+0000 7f0161800640 1 -- 172.21.15.142:0/1486650408 >> v1:172.21.15.179:6789/0 conn(0x7f015c06d740 legacy=0x7f015c0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.674+0000 7f0161800640 1 -- 172.21.15.142:0/1486650408 >> v1:172.21.15.142:6789/0 conn(0x7f015c0af060 legacy=0x7f015c0b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.674+0000 7f0161800640 1 -- 172.21.15.142:0/1486650408 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c06db20 con 0x7f015c0b20f0 2024-04-01T15:23:54.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.674+0000 7f015be00640 1 -- 172.21.15.142:0/1486650408 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505573513 0 0) 0x7f015c0b12e0 con 0x7f015c0af060 2024-04-01T15:23:54.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.675+0000 7f0161800640 1 --2- 172.21.15.142:0/1486650408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c0b20f0 0x7f015c0b2540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0154009d90 tx=0x7f015402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a40d0436151384 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.675+0000 7f015be00640 1 -- 172.21.15.142:0/1486650408 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154039070 con 0x7f015c0b20f0 2024-04-01T15:23:54.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.675+0000 7f015be00640 1 -- 172.21.15.142:0/1486650408 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015402cd00 con 0x7f015c0b20f0 2024-04-01T15:23:54.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.675+0000 7f015be00640 1 -- 172.21.15.142:0/1486650408 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154034660 con 0x7f015c0b20f0 2024-04-01T15:23:54.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.676+0000 7f0162200640 1 -- 172.21.15.142:0/1486650408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c0b20f0 msgr2=0x7f015c0b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.676+0000 7f0162200640 1 --2- 172.21.15.142:0/1486650408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c0b20f0 0x7f015c0b2540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0154009d90 tx=0x7f015402bf50 comp rx=0 tx=0).stop 2024-04-01T15:23:54.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.676+0000 7f0162200640 1 -- 172.21.15.142:0/1486650408 shutdown_connections 2024-04-01T15:23:54.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.676+0000 7f0162200640 1 --2- 172.21.15.142:0/1486650408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c0b20f0 0x7f015c0b2540 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.676+0000 7f0162200640 1 -- 172.21.15.142:0/1486650408 >> 172.21.15.142:0/1486650408 conn(0x7f015c0b5790 msgr2=0x7f015c0b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:54.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.676+0000 7f0162200640 1 -- 172.21.15.142:0/1486650408 shutdown_connections 2024-04-01T15:23:54.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.676+0000 7f0162200640 1 -- 172.21.15.142:0/1486650408 wait complete. 2024-04-01T15:23:54.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.677+0000 7f0162200640 1 Processor -- start 2024-04-01T15:23:54.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.678+0000 7f0162200640 1 -- start start 2024-04-01T15:23:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.678+0000 7f0162200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c06d740 0x7f015c141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.678+0000 7f0162200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f015c0af060 0x7f015c1cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.678+0000 7f0162200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f015c0b20f0 0x7f015c1d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.678+0000 7f0162200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f015c0b1550 con 0x7f015c06d740 2024-04-01T15:23:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.678+0000 7f0162200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f015c0b5120 con 0x7f015c0b20f0 2024-04-01T15:23:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.678+0000 7f0162200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f015c0afdf0 con 0x7f015c0af060 2024-04-01T15:23:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0160e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c06d740 0x7f015c141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0160e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c06d740 0x7f015c141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38050/0 (socket says 172.21.15.142:38050) 2024-04-01T15:23:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0160e00640 1 -- 172.21.15.142:0/3806655888 learned_addr learned my addr 172.21.15.142:0/3806655888 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0153e00640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f015c0af060 0x7f015c1cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0161800640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f015c0b20f0 0x7f015c1d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0160e00640 1 -- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f015c0af060 msgr2=0x7f015c1cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0160e00640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f015c0af060 0x7f015c1cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0160e00640 1 -- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f015c0b20f0 msgr2=0x7f015c1d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0160e00640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f015c0b20f0 0x7f015c1d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0160e00640 1 -- 172.21.15.142:0/3806655888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c0701f0 con 0x7f015c06d740 2024-04-01T15:23:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0153e00640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f015c0af060 0x7f015c1cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.679+0000 7f0160e00640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c06d740 0x7f015c141ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f014c00c450 tx=0x7f014c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.680+0000 7f0159600640 1 -- 172.21.15.142:0/3806655888 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c0052d0 con 0x7f015c06d740 2024-04-01T15:23:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.680+0000 7f0159600640 1 -- 172.21.15.142:0/3806655888 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014c005470 con 0x7f015c06d740 2024-04-01T15:23:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.680+0000 7f0159600640 1 -- 172.21.15.142:0/3806655888 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c012870 con 0x7f015c06d740 2024-04-01T15:23:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.680+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015c06f850 con 0x7f015c06d740 2024-04-01T15:23:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.680+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015c0b6e90 con 0x7f015c06d740 2024-04-01T15:23:54.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.681+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f015c070f10 con 0x7f015c06d740 2024-04-01T15:23:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.682+0000 7f0159600640 1 -- 172.21.15.142:0/3806655888 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f014c012a10 con 0x7f015c06d740 2024-04-01T15:23:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.683+0000 7f0159600640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f013806c8f0 0x7f013806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.683+0000 7f0159600640 1 -- 172.21.15.142:0/3806655888 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f014c08b7e0 con 0x7f015c06d740 2024-04-01T15:23:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.683+0000 7f0159600640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7f0138074c70 0x7f01380770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.683+0000 7f0159600640 1 -- 172.21.15.142:0/3806655888 --> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f014c007650 con 0x7f0138074c70 2024-04-01T15:23:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.683+0000 7f0159600640 1 -- 172.21.15.142:0/3806655888 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f014c092050 con 0x7f015c06d740 2024-04-01T15:23:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.683+0000 7f0153e00640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f013806c8f0 0x7f013806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.684+0000 7f0161800640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7f0138074c70 0x7f01380770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.684+0000 7f0153e00640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f013806c8f0 0x7f013806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f015c0b7370 tx=0x7f0144009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.685+0000 7f0161800640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7f0138074c70 0x7f01380770f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.687+0000 7f0159600640 1 -- 172.21.15.142:0/3806655888 <== osd.6 v2:172.21.15.179:6800/1199445012 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f014c007650 con 0x7f0138074c70 2024-04-01T15:23:54.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.701+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 --> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f015c068590 con 0x7f0138074c70 2024-04-01T15:23:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.702+0000 7f0159600640 1 -- 172.21.15.142:0/3806655888 <== osd.6 v2:172.21.15.179:6800/1199445012 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f015c068590 con 0x7f0138074c70 2024-04-01T15:23:54.703 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-01T15:23:54.703 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T15:23:54.703 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-01T15:23:54.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.702+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7f0138074c70 msgr2=0x7f01380770f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.702+0000 7f0162200640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6800/1199445012,v1:172.21.15.179:6801/1199445012] conn(0x7f0138074c70 0x7f01380770f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.703+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f013806c8f0 msgr2=0x7f013806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.703+0000 7f0162200640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f013806c8f0 0x7f013806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f015c0b7370 tx=0x7f0144009040 comp rx=0 tx=0).stop 2024-04-01T15:23:54.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.703+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c06d740 msgr2=0x7f015c141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.703+0000 7f0162200640 1 --2- 172.21.15.142:0/3806655888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f015c06d740 0x7f015c141ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f014c00c450 tx=0x7f014c00c910 comp rx=0 tx=0).stop 2024-04-01T15:23:54.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.703+0000 7f0161800640 1 -- 172.21.15.142:0/3806655888 reap_dead start 2024-04-01T15:23:54.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.703+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 shutdown_connections 2024-04-01T15:23:54.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.703+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 >> 172.21.15.142:0/3806655888 conn(0x7f015c0b5790 msgr2=0x7f015c13e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:54.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.703+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 shutdown_connections 2024-04-01T15:23:54.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.703+0000 7f0162200640 1 -- 172.21.15.142:0/3806655888 wait complete. 2024-04-01T15:23:54.722 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-01T15:23:54.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.929+0000 7f0f7ba00640 1 Processor -- start 2024-04-01T15:23:54.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.929+0000 7f0f7ba00640 1 -- start start 2024-04-01T15:23:54.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.931+0000 7f0f7ba00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0f740b5fd0 0x7f0f7414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.931+0000 7f0f7ba00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f7414b610 0x7f0f74152180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.931+0000 7f0f7ba00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f740bde40 con 0x7f0f740bda60 2024-04-01T15:23:54.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.931+0000 7f0f7ba00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7414ba60 con 0x7f0f740b5fd0 2024-04-01T15:23:54.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.931+0000 7f0f7ba00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0f740b5120 con 0x7f0f7414b610 2024-04-01T15:23:54.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.931+0000 7f0f73e00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0f740b5fd0 0x7f0f7414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.931+0000 7f0f79a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f7414b610 0x7f0f74152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.931+0000 7f0f79a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f7414b610 0x7f0f74152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:59016/0 (socket says 172.21.15.142:59016) 2024-04-01T15:23:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.931+0000 7f0f79a00640 1 -- 172.21.15.142:0/2780033009 learned_addr learned my addr 172.21.15.142:0/2780033009 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.932+0000 7f0f73e00640 1 -- 172.21.15.142:0/2780033009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f7414b610 msgr2=0x7f0f74152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.932+0000 7f0f73e00640 1 --2- 172.21.15.142:0/2780033009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f7414b610 0x7f0f74152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.932+0000 7f0f73e00640 1 -- 172.21.15.142:0/2780033009 >> v1:172.21.15.179:6789/0 conn(0x7f0f740bda60 legacy=0x7f0f74141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.932+0000 7f0f73e00640 1 -- 172.21.15.142:0/2780033009 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f740b53e0 con 0x7f0f740b5fd0 2024-04-01T15:23:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.932+0000 7f0f79a00640 1 --2- 172.21.15.142:0/2780033009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f7414b610 0x7f0f74152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:23:54.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.933+0000 7f0f73e00640 1 --2- 172.21.15.142:0/2780033009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f740b5fd0 0x7f0f7414b0d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0f600097a0 tx=0x7f0f6002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42577775ef6af31c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.934+0000 7f0f73400640 1 -- 172.21.15.142:0/2780033009 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60031780 con 0x7f0f740b5fd0 2024-04-01T15:23:54.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.934+0000 7f0f73400640 1 -- 172.21.15.142:0/2780033009 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f60037070 con 0x7f0f740b5fd0 2024-04-01T15:23:54.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.934+0000 7f0f73400640 1 -- 172.21.15.142:0/2780033009 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60031b40 con 0x7f0f740b5fd0 2024-04-01T15:23:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.934+0000 7f0f7ba00640 1 -- 172.21.15.142:0/2780033009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f740b5fd0 msgr2=0x7f0f7414b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.934+0000 7f0f7ba00640 1 --2- 172.21.15.142:0/2780033009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f740b5fd0 0x7f0f7414b0d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0f600097a0 tx=0x7f0f6002b820 comp rx=0 tx=0).stop 2024-04-01T15:23:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.935+0000 7f0f7ba00640 1 -- 172.21.15.142:0/2780033009 shutdown_connections 2024-04-01T15:23:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.935+0000 7f0f7ba00640 1 --2- 172.21.15.142:0/2780033009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f7414b610 0x7f0f74152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.935+0000 7f0f7ba00640 1 --2- 172.21.15.142:0/2780033009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f740b5fd0 0x7f0f7414b0d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.935+0000 7f0f7ba00640 1 -- 172.21.15.142:0/2780033009 >> 172.21.15.142:0/2780033009 conn(0x7f0f740734b0 msgr2=0x7f0f740bd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:54.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.935+0000 7f0f7ba00640 1 -- 172.21.15.142:0/2780033009 shutdown_connections 2024-04-01T15:23:54.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.935+0000 7f0f7ba00640 1 -- 172.21.15.142:0/2780033009 wait complete. 2024-04-01T15:23:54.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.937+0000 7f0f7ba00640 1 Processor -- start 2024-04-01T15:23:54.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.937+0000 7f0f7ba00640 1 -- start start 2024-04-01T15:23:54.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f7ba00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f740b5fd0 0x7f0f741481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f7ba00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f740bda60 0x7f0f74144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f7ba00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7414b610 0x7f0f7413e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f7ba00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0f740b49c0 con 0x7f0f7414b610 2024-04-01T15:23:54.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f7ba00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0f740b70a0 con 0x7f0f740b5fd0 2024-04-01T15:23:54.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f7ba00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0f740b4b40 con 0x7f0f740bda60 2024-04-01T15:23:54.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f79a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7414b610 0x7f0f7413e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f79a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7414b610 0x7f0f7413e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40046/0 (socket says 172.21.15.142:40046) 2024-04-01T15:23:54.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f79a00640 1 -- 172.21.15.142:0/405950555 learned_addr learned my addr 172.21.15.142:0/405950555 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:54.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f73e00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f740bda60 0x7f0f74144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f79000640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f740b5fd0 0x7f0f741481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f79a00640 1 -- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f740bda60 msgr2=0x7f0f74144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f79a00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f740bda60 0x7f0f74144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f79a00640 1 -- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f740b5fd0 msgr2=0x7f0f741481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:54.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f79a00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f740b5fd0 0x7f0f741481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:54.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f79a00640 1 -- 172.21.15.142:0/405950555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f74147a60 con 0x7f0f7414b610 2024-04-01T15:23:54.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.938+0000 7f0f73e00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f740bda60 0x7f0f74144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:54.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.939+0000 7f0f79a00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7414b610 0x7f0f7413e210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00efc0 tx=0x7f0f6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.939+0000 7f0f70c00640 1 -- 172.21.15.142:0/405950555 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00cb80 con 0x7f0f7414b610 2024-04-01T15:23:54.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.939+0000 7f0f70c00640 1 -- 172.21.15.142:0/405950555 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c00cd20 con 0x7f0f7414b610 2024-04-01T15:23:54.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.939+0000 7f0f70c00640 1 -- 172.21.15.142:0/405950555 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c003bb0 con 0x7f0f7414b610 2024-04-01T15:23:54.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.939+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f741459b0 con 0x7f0f7414b610 2024-04-01T15:23:54.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.939+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f74146460 con 0x7f0f7414b610 2024-04-01T15:23:54.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.941+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f74146660 con 0x7f0f7414b610 2024-04-01T15:23:54.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.941+0000 7f0f70c00640 1 -- 172.21.15.142:0/405950555 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f6c01b030 con 0x7f0f7414b610 2024-04-01T15:23:54.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.942+0000 7f0f70c00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0f5406c8f0 0x7f0f5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:54.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.942+0000 7f0f70c00640 1 -- 172.21.15.142:0/405950555 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0f6c08bf00 con 0x7f0f7414b610 2024-04-01T15:23:54.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.943+0000 7f0f79000640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0f5406c8f0 0x7f0f5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:54.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.944+0000 7f0f79000640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0f5406c8f0 0x7f0f5406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f741d4b70 tx=0x7f0f64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:54.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:54.949+0000 7f0f70c00640 1 -- 172.21.15.142:0/405950555 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0f74146660 con 0x7f0f7414b610 2024-04-01T15:23:55.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.150+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f0f74145fc0 con 0x7f0f5406c8f0 2024-04-01T15:23:55.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.151+0000 7f0f70c00640 1 -- 172.21.15.142:0/405950555 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0f640050d0 con 0x7f0f5406c8f0 2024-04-01T15:23:55.152 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 6 to deep-scrub 2024-04-01T15:23:55.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0f5406c8f0 msgr2=0x7f0f5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0f5406c8f0 0x7f0f5406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f741d4b70 tx=0x7f0f64009040 comp rx=0 tx=0).stop 2024-04-01T15:23:55.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7414b610 msgr2=0x7f0f7413e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7414b610 0x7f0f7413e210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00efc0 tx=0x7f0f6c00c490 comp rx=0 tx=0).stop 2024-04-01T15:23:55.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 shutdown_connections 2024-04-01T15:23:55.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f0f5406c8f0 0x7f0f5406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7414b610 0x7f0f7413e210 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f740bda60 0x7f0f74144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 --2- 172.21.15.142:0/405950555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f740b5fd0 0x7f0f741481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 >> 172.21.15.142:0/405950555 conn(0x7f0f740734b0 msgr2=0x7f0f740ba290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:55.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 shutdown_connections 2024-04-01T15:23:55.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.154+0000 7f0f7ba00640 1 -- 172.21.15.142:0/405950555 wait complete. 2024-04-01T15:23:55.174 INFO:tasks.ceph:Scrubbing osd.7 2024-04-01T15:23:55.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-01T15:23:55.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.392+0000 7fc31d400640 1 Processor -- start 2024-04-01T15:23:55.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.392+0000 7fc31d400640 1 -- start start 2024-04-01T15:23:55.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.394+0000 7fc31d400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc31806d740 0x7fc3180b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.394+0000 7fc31d400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc31814b490 0x7fc318072960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.394+0000 7fc31d400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31806db20 con 0x7fc3180b5250 2024-04-01T15:23:55.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.394+0000 7fc31d400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc3180ae670 con 0x7fc31806d740 2024-04-01T15:23:55.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.394+0000 7fc31d400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fc3180ae950 con 0x7fc31814b490 2024-04-01T15:23:55.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.394+0000 7fc317400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc3180b5250 0x7fc31814ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33230/0 (socket says 172.21.15.142:33230) 2024-04-01T15:23:55.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.394+0000 7fc317400640 1 -- 172.21.15.142:0/3577891130 learned_addr learned my addr 172.21.15.142:0/3577891130 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:55.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.394+0000 7fc317e00640 1 --2- 172.21.15.142:0/3577891130 >> v2:172.21.15.142:3300/0 conn(0x7fc31806d740 0x7fc3180b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.394+0000 7fc31ca00640 1 --2- 172.21.15.142:0/3577891130 >> v2:172.21.15.179:3300/0 conn(0x7fc31814b490 0x7fc318072960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.395+0000 7fc316a00640 1 -- 172.21.15.142:0/3577891130 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754399359 0 0) 0x7fc31806db20 con 0x7fc3180b5250 2024-04-01T15:23:55.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.395+0000 7fc317e00640 1 -- 172.21.15.142:0/3577891130 >> v2:172.21.15.179:3300/0 conn(0x7fc31814b490 msgr2=0x7fc318072960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:55.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.395+0000 7fc317e00640 1 --2- 172.21.15.142:0/3577891130 >> v2:172.21.15.179:3300/0 conn(0x7fc31814b490 0x7fc318072960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.395+0000 7fc317e00640 1 -- 172.21.15.142:0/3577891130 >> v1:172.21.15.142:6789/0 conn(0x7fc3180b5250 legacy=0x7fc31814ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.395+0000 7fc317e00640 1 -- 172.21.15.142:0/3577891130 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3180aec30 con 0x7fc31806d740 2024-04-01T15:23:55.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.395+0000 7fc31ca00640 1 --2- 172.21.15.142:0/3577891130 >> v2:172.21.15.179:3300/0 conn(0x7fc31814b490 0x7fc318072960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:23:55.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.396+0000 7fc317e00640 1 --2- 172.21.15.142:0/3577891130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc31806d740 0x7fc3180b4d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc31806e140 tx=0x7fc30802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20dcec9e0cf1e4ae server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:55.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.396+0000 7fc316a00640 1 -- 172.21.15.142:0/3577891130 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308038070 con 0x7fc31806d740 2024-04-01T15:23:55.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.396+0000 7fc316a00640 1 -- 172.21.15.142:0/3577891130 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc308031520 con 0x7fc31806d740 2024-04-01T15:23:55.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.396+0000 7fc316a00640 1 -- 172.21.15.142:0/3577891130 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3080318f0 con 0x7fc31806d740 2024-04-01T15:23:55.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.396+0000 7fc31d400640 1 -- 172.21.15.142:0/3577891130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc31806d740 msgr2=0x7fc3180b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.396+0000 7fc31d400640 1 --2- 172.21.15.142:0/3577891130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc31806d740 0x7fc3180b4d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc31806e140 tx=0x7fc30802b7c0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.397+0000 7fc31d400640 1 -- 172.21.15.142:0/3577891130 shutdown_connections 2024-04-01T15:23:55.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.397+0000 7fc31d400640 1 --2- 172.21.15.142:0/3577891130 >> v2:172.21.15.179:3300/0 conn(0x7fc31814b490 0x7fc318072960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.397+0000 7fc31d400640 1 --2- 172.21.15.142:0/3577891130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc31806d740 0x7fc3180b4d10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.397+0000 7fc31d400640 1 -- 172.21.15.142:0/3577891130 >> 172.21.15.142:0/3577891130 conn(0x7fc3180b5790 msgr2=0x7fc3180b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:55.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.397+0000 7fc31d400640 1 -- 172.21.15.142:0/3577891130 shutdown_connections 2024-04-01T15:23:55.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.397+0000 7fc31d400640 1 -- 172.21.15.142:0/3577891130 wait complete. 2024-04-01T15:23:55.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.398+0000 7fc31d400640 1 Processor -- start 2024-04-01T15:23:55.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.398+0000 7fc31d400640 1 -- start start 2024-04-01T15:23:55.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.399+0000 7fc31d400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31806d740 0x7fc318147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.399+0000 7fc31d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3180b5250 0x7fc318142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.399+0000 7fc31d400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31814b490 0x7fc318143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.399+0000 7fc31d400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc318073020 con 0x7fc3180b5250 2024-04-01T15:23:55.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.399+0000 7fc31d400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc318072ea0 con 0x7fc31814b490 2024-04-01T15:23:55.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.399+0000 7fc31d400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc3180731a0 con 0x7fc31806d740 2024-04-01T15:23:55.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.399+0000 7fc317400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3180b5250 0x7fc318142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.399+0000 7fc317400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3180b5250 0x7fc318142b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40062/0 (socket says 172.21.15.142:40062) 2024-04-01T15:23:55.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.399+0000 7fc317400640 1 -- 172.21.15.142:0/4284525486 learned_addr learned my addr 172.21.15.142:0/4284525486 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:55.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc31ca00640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31814b490 0x7fc318143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc317e00640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31806d740 0x7fc318147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc317400640 1 -- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31806d740 msgr2=0x7fc318147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc317400640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31806d740 0x7fc318147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc317400640 1 -- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31814b490 msgr2=0x7fc318143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc317400640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31814b490 0x7fc318143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc317400640 1 -- 172.21.15.142:0/4284525486 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc318144290 con 0x7fc3180b5250 2024-04-01T15:23:55.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc31ca00640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31814b490 0x7fc318143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:55.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc317400640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3180b5250 0x7fc318142b20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc30400c430 tx=0x7fc30400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:55.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc30fe00640 1 -- 172.21.15.142:0/4284525486 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3040074e0 con 0x7fc3180b5250 2024-04-01T15:23:55.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc30fe00640 1 -- 172.21.15.142:0/4284525486 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3040047e0 con 0x7fc3180b5250 2024-04-01T15:23:55.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc30fe00640 1 -- 172.21.15.142:0/4284525486 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304004bd0 con 0x7fc3180b5250 2024-04-01T15:23:55.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.400+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc318144570 con 0x7fc3180b5250 2024-04-01T15:23:55.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.401+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc318144e10 con 0x7fc3180b5250 2024-04-01T15:23:55.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.401+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc318073770 con 0x7fc3180b5250 2024-04-01T15:23:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.403+0000 7fc30fe00640 1 -- 172.21.15.142:0/4284525486 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc304011070 con 0x7fc3180b5250 2024-04-01T15:23:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.403+0000 7fc30fe00640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fc2f806c970 0x7fc2f806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.403+0000 7fc30fe00640 1 -- 172.21.15.142:0/4284525486 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fc30408b6b0 con 0x7fc3180b5250 2024-04-01T15:23:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.404+0000 7fc30fe00640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7fc2f8074d10 0x7fc2f8077190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.404+0000 7fc30fe00640 1 -- 172.21.15.142:0/4284525486 --> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc30401ee50 con 0x7fc2f8074d10 2024-04-01T15:23:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.404+0000 7fc30fe00640 1 -- 172.21.15.142:0/4284525486 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc304092050 con 0x7fc3180b5250 2024-04-01T15:23:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.404+0000 7fc317e00640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fc2f806c970 0x7fc2f806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.404+0000 7fc31ca00640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7fc2f8074d10 0x7fc2f8077190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.405+0000 7fc317e00640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fc2f806c970 0x7fc2f806ee30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc308035000 tx=0x7fc308030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:55.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.405+0000 7fc31ca00640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7fc2f8074d10 0x7fc2f8077190 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:55.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.407+0000 7fc30fe00640 1 -- 172.21.15.142:0/4284525486 <== osd.7 v2:172.21.15.179:6806/3234577124 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc30401ee50 con 0x7fc2f8074d10 2024-04-01T15:23:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.422+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 --> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc318068590 con 0x7fc2f8074d10 2024-04-01T15:23:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.423+0000 7fc30fe00640 1 -- 172.21.15.142:0/4284525486 <== osd.7 v2:172.21.15.179:6806/3234577124 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc318068590 con 0x7fc2f8074d10 2024-04-01T15:23:55.424 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-01T15:23:55.425 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T15:23:55.425 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-01T15:23:55.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7fc2f8074d10 msgr2=0x7fc2f8077190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6806/3234577124,v1:172.21.15.179:6809/3234577124] conn(0x7fc2f8074d10 0x7fc2f8077190 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fc2f806c970 msgr2=0x7fc2f806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fc2f806c970 0x7fc2f806ee30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc308035000 tx=0x7fc308030000 comp rx=0 tx=0).stop 2024-04-01T15:23:55.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3180b5250 msgr2=0x7fc318142b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 --2- 172.21.15.142:0/4284525486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3180b5250 0x7fc318142b20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc30400c430 tx=0x7fc30400c8f0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31ca00640 1 -- 172.21.15.142:0/4284525486 reap_dead start 2024-04-01T15:23:55.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 shutdown_connections 2024-04-01T15:23:55.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 >> 172.21.15.142:0/4284525486 conn(0x7fc3180b5790 msgr2=0x7fc31806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:55.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 shutdown_connections 2024-04-01T15:23:55.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.424+0000 7fc31d400640 1 -- 172.21.15.142:0/4284525486 wait complete. 2024-04-01T15:23:55.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-01T15:23:55.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.649+0000 7fdaf9800640 1 Processor -- start 2024-04-01T15:23:55.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.649+0000 7fdaf9800640 1 -- start start 2024-04-01T15:23:55.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf9800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdaf406d8d0 0x7fdaf40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf9800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf40b0fb0 0x7fdaf41491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf9800640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf406dcb0 con 0x7fdaf4149720 2024-04-01T15:23:55.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf9800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf40b0b20 con 0x7fdaf406d8d0 2024-04-01T15:23:55.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf9800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf4148ad0 con 0x7fdaf40b0fb0 2024-04-01T15:23:55.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf2a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdaf406d8d0 0x7fdaf40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf2a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdaf406d8d0 0x7fdaf40b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40066/0 (socket says 172.21.15.142:40066) 2024-04-01T15:23:55.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf2a00640 1 -- 172.21.15.142:0/2319017183 learned_addr learned my addr 172.21.15.142:0/2319017183 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:55.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf2000640 1 --2- 172.21.15.142:0/2319017183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf40b0fb0 0x7fdaf41491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf2a00640 1 -- 172.21.15.142:0/2319017183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf40b0fb0 msgr2=0x7fdaf41491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:55.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.651+0000 7fdaf2a00640 1 --2- 172.21.15.142:0/2319017183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf40b0fb0 0x7fdaf41491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.652+0000 7fdaf2a00640 1 -- 172.21.15.142:0/2319017183 >> v1:172.21.15.179:6789/0 conn(0x7fdaf4149720 legacy=0x7fdaf40b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:55.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.652+0000 7fdaf2a00640 1 -- 172.21.15.142:0/2319017183 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf40b5230 con 0x7fdaf406d8d0 2024-04-01T15:23:55.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.653+0000 7fdaf2a00640 1 --2- 172.21.15.142:0/2319017183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf406d8d0 0x7fdaf40b2d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009870 tx=0x7fdae402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3029f1d765b1b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:55.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.653+0000 7fdaf1600640 1 -- 172.21.15.142:0/2319017183 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4035020 con 0x7fdaf406d8d0 2024-04-01T15:23:55.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.653+0000 7fdaf1600640 1 -- 172.21.15.142:0/2319017183 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae4031640 con 0x7fdaf406d8d0 2024-04-01T15:23:55.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.653+0000 7fdaf1600640 1 -- 172.21.15.142:0/2319017183 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae402d040 con 0x7fdaf406d8d0 2024-04-01T15:23:55.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.654+0000 7fdaf9800640 1 -- 172.21.15.142:0/2319017183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf406d8d0 msgr2=0x7fdaf40b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.654+0000 7fdaf9800640 1 --2- 172.21.15.142:0/2319017183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf406d8d0 0x7fdaf40b2d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009870 tx=0x7fdae402b8f0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.654+0000 7fdaf9800640 1 -- 172.21.15.142:0/2319017183 shutdown_connections 2024-04-01T15:23:55.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.654+0000 7fdaf9800640 1 --2- 172.21.15.142:0/2319017183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf40b0fb0 0x7fdaf41491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.654+0000 7fdaf9800640 1 --2- 172.21.15.142:0/2319017183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf406d8d0 0x7fdaf40b2d20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.654+0000 7fdaf9800640 1 -- 172.21.15.142:0/2319017183 >> 172.21.15.142:0/2319017183 conn(0x7fdaf40b5890 msgr2=0x7fdaf40b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:55.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.654+0000 7fdaf9800640 1 -- 172.21.15.142:0/2319017183 shutdown_connections 2024-04-01T15:23:55.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.654+0000 7fdaf9800640 1 -- 172.21.15.142:0/2319017183 wait complete. 2024-04-01T15:23:55.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.655+0000 7fdaf9800640 1 Processor -- start 2024-04-01T15:23:55.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.656+0000 7fdaf9800640 1 -- start start 2024-04-01T15:23:55.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.656+0000 7fdaf9800640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf406d8d0 0x7fdaf413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.656+0000 7fdaf9800640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaf40b0fb0 0x7fdaf41451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.656+0000 7fdaf9800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf4149720 0x7fdaf4144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.656+0000 7fdaf9800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf40b4fd0 con 0x7fdaf4149720 2024-04-01T15:23:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.656+0000 7fdaf9800640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf40b4e50 con 0x7fdaf40b0fb0 2024-04-01T15:23:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.656+0000 7fdaf9800640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf409edc0 con 0x7fdaf406d8d0 2024-04-01T15:23:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf4149720 0x7fdaf4144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf4149720 0x7fdaf4144210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40074/0 (socket says 172.21.15.142:40074) 2024-04-01T15:23:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf3400640 1 -- 172.21.15.142:0/864262307 learned_addr learned my addr 172.21.15.142:0/864262307 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf2a00640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf406d8d0 0x7fdaf413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf2000640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaf40b0fb0 0x7fdaf41451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf3400640 1 -- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf406d8d0 msgr2=0x7fdaf413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf3400640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf406d8d0 0x7fdaf413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf3400640 1 -- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaf40b0fb0 msgr2=0x7fdaf41451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf3400640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaf40b0fb0 0x7fdaf41451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf3400640 1 -- 172.21.15.142:0/864262307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf4145b80 con 0x7fdaf4149720 2024-04-01T15:23:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.657+0000 7fdaf3400640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf4149720 0x7fdaf4144210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00b410 tx=0x7fdaec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.658+0000 7fdaeaa00640 1 -- 172.21.15.142:0/864262307 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec015030 con 0x7fdaf4149720 2024-04-01T15:23:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.658+0000 7fdaeaa00640 1 -- 172.21.15.142:0/864262307 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaec004020 con 0x7fdaf4149720 2024-04-01T15:23:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.658+0000 7fdaeaa00640 1 -- 172.21.15.142:0/864262307 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec004410 con 0x7fdaf4149720 2024-04-01T15:23:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.658+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf41439e0 con 0x7fdaf4149720 2024-04-01T15:23:55.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.658+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf41456f0 con 0x7fdaf4149720 2024-04-01T15:23:55.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.659+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf4068710 con 0x7fdaf4149720 2024-04-01T15:23:55.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.660+0000 7fdaeaa00640 1 -- 172.21.15.142:0/864262307 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdaec018070 con 0x7fdaf4149720 2024-04-01T15:23:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.661+0000 7fdaeaa00640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fdad006c920 0x7fdad006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.661+0000 7fdaeaa00640 1 -- 172.21.15.142:0/864262307 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fdaec08b5e0 con 0x7fdaf4149720 2024-04-01T15:23:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.662+0000 7fdaf2a00640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fdad006c920 0x7fdad006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.663+0000 7fdaf2a00640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fdad006c920 0x7fdad006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdae4036000 tx=0x7fdae403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.665+0000 7fdaeaa00640 1 -- 172.21.15.142:0/864262307 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdaec059a20 con 0x7fdaf4149720 2024-04-01T15:23:55.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.868+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fdaf4143830 con 0x7fdad006c920 2024-04-01T15:23:55.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.869+0000 7fdaeaa00640 1 -- 172.21.15.142:0/864262307 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdaf4143830 con 0x7fdad006c920 2024-04-01T15:23:55.870 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 7 to deep-scrub 2024-04-01T15:23:55.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fdad006c920 msgr2=0x7fdad006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fdad006c920 0x7fdad006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdae4036000 tx=0x7fdae403c040 comp rx=0 tx=0).stop 2024-04-01T15:23:55.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf4149720 msgr2=0x7fdaf4144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:55.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf4149720 0x7fdaf4144210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00b410 tx=0x7fdaec00b8d0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 shutdown_connections 2024-04-01T15:23:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fdad006c920 0x7fdad006ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf4149720 0x7fdaf4144210 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaf40b0fb0 0x7fdaf41451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 --2- 172.21.15.142:0/864262307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf406d8d0 0x7fdaf413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 >> 172.21.15.142:0/864262307 conn(0x7fdaf40b5890 msgr2=0x7fdaf413e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 shutdown_connections 2024-04-01T15:23:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:55.872+0000 7fdaf9800640 1 -- 172.21.15.142:0/864262307 wait complete. 2024-04-01T15:23:55.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:23:56.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.101+0000 7f89b3000640 1 Processor -- start 2024-04-01T15:23:56.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.101+0000 7f89b3000640 1 -- start start 2024-04-01T15:23:56.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.102+0000 7f89b3000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f89ac0b5be0 0x7f89ac0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:56.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.102+0000 7f89b3000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0afbe0 0x7f89ac0ae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:56.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.102+0000 7f89b3000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac0b5fc0 con 0x7f89ac0af080 2024-04-01T15:23:56.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.102+0000 7f89b3000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f89ac0b5610 con 0x7f89ac0b5be0 2024-04-01T15:23:56.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.102+0000 7f89b3000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac0b1230 con 0x7f89ac0afbe0 2024-04-01T15:23:56.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.102+0000 7f89b1200640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f89ac0af080 0x7f89ac0add40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33242/0 (socket says 172.21.15.142:33242) 2024-04-01T15:23:56.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.102+0000 7f89b1200640 1 -- 172.21.15.142:0/3734513608 learned_addr learned my addr 172.21.15.142:0/3734513608 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:23:56.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89b1c00640 1 --2- 172.21.15.142:0/3734513608 >> v2:172.21.15.179:3300/0 conn(0x7f89ac0b5be0 0x7f89ac0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:56.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89b2600640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0afbe0 0x7f89ac0ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:56.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1696593886 0 0) 0x7f89ac0b5fc0 con 0x7f89ac0af080 2024-04-01T15:23:56.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8994003520 con 0x7f89ac0af080 2024-04-01T15:23:56.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1194129704 0 0) 0x7f8994003520 con 0x7f89ac0af080 2024-04-01T15:23:56.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0afbe0 msgr2=0x7f89ac0ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:56.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0afbe0 0x7f89ac0ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 >> v2:172.21.15.179:3300/0 conn(0x7f89ac0b5be0 msgr2=0x7f89ac0af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:56.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 --2- 172.21.15.142:0/3734513608 >> v2:172.21.15.179:3300/0 conn(0x7f89ac0b5be0 0x7f89ac0af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac0b1510 con 0x7f89ac0af080 2024-04-01T15:23:56.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f89980017f0 con 0x7f89ac0af080 2024-04-01T15:23:56.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 >> v1:172.21.15.142:6789/0 conn(0x7f89ac0af080 legacy=0x7f89ac0add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:56.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89940039e0 0x7f8994003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:56.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0afbe0 0x7f8994004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:56.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8994004d40 0x7f89940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:56.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0b5610 con 0x7f8994004d40 2024-04-01T15:23:56.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0b1230 con 0x7f89940039e0 2024-04-01T15:23:56.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f899400ba10 con 0x7f89ac0afbe0 2024-04-01T15:23:56.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.103+0000 7f89b2600640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8994004d40 0x7f89940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:56.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.104+0000 7f89b1c00640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89940039e0 0x7f8994003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:56.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.104+0000 7f89b1200640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0afbe0 0x7f8994004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:56.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.104+0000 7f89b2600640 1 -- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0afbe0 msgr2=0x7f8994004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:56.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.104+0000 7f89b2600640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0afbe0 0x7f8994004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.104+0000 7f89b2600640 1 -- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89940039e0 msgr2=0x7f8994003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:23:56.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.104+0000 7f89b2600640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89940039e0 0x7f8994003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.104+0000 7f89b2600640 1 -- 172.21.15.142:0/3734513608 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8994003520 con 0x7f8994004d40 2024-04-01T15:23:56.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.104+0000 7f89b1200640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0afbe0 0x7f8994004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:56.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.105+0000 7f89b2600640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8994004d40 0x7f89940051c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f89a400e170 tx=0x7f8994005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91bbcecf3b552b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:56.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.105+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4039070 con 0x7f8994004d40 2024-04-01T15:23:56.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.105+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a402cbf0 con 0x7f8994004d40 2024-04-01T15:23:56.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.105+0000 7f89abe00640 1 -- 172.21.15.142:0/3734513608 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4009c10 con 0x7f8994004d40 2024-04-01T15:23:56.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.106+0000 7f89b3000640 1 -- 172.21.15.142:0/3734513608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8994004d40 msgr2=0x7f89940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.106+0000 7f89b3000640 1 --2- 172.21.15.142:0/3734513608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8994004d40 0x7f89940051c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f89a400e170 tx=0x7f8994005830 comp rx=0 tx=0).stop 2024-04-01T15:23:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.106+0000 7f89b2600640 1 -- 172.21.15.142:0/3734513608 reap_dead start 2024-04-01T15:23:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.106+0000 7f89b3000640 1 -- 172.21.15.142:0/3734513608 shutdown_connections 2024-04-01T15:23:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.106+0000 7f89b3000640 1 -- 172.21.15.142:0/3734513608 >> 172.21.15.142:0/3734513608 conn(0x7f89ac06c710 msgr2=0x7f89ac06cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.106+0000 7f89b3000640 1 -- 172.21.15.142:0/3734513608 shutdown_connections 2024-04-01T15:23:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.106+0000 7f89b3000640 1 -- 172.21.15.142:0/3734513608 wait complete. 2024-04-01T15:23:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.108+0000 7f89b3000640 1 Processor -- start 2024-04-01T15:23:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.108+0000 7f89b3000640 1 -- start start 2024-04-01T15:23:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.108+0000 7f89b3000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994004d40 0x7f89ac13eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.108+0000 7f89b3000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac1405c0 0x7f89ac13f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b3000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac132d50 0x7f89ac0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b3000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0b50f0 con 0x7f89ac1405c0 2024-04-01T15:23:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b3000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0b4e10 con 0x7f8994004d40 2024-04-01T15:23:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b3000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac0b30c0 con 0x7f89ac132d50 2024-04-01T15:23:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac1405c0 0x7f89ac13f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac1405c0 0x7f89ac13f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40086/0 (socket says 172.21.15.142:40086) 2024-04-01T15:23:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1200640 1 -- 172.21.15.142:0/3758471692 learned_addr learned my addr 172.21.15.142:0/3758471692 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:23:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1c00640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994004d40 0x7f89ac13eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b2600640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac132d50 0x7f89ac0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1200640 1 -- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac132d50 msgr2=0x7f89ac0707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1200640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac132d50 0x7f89ac0707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1200640 1 -- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994004d40 msgr2=0x7f89ac13eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1200640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994004d40 0x7f89ac13eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1200640 1 -- 172.21.15.142:0/3758471692 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac071870 con 0x7f89ac1405c0 2024-04-01T15:23:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1c00640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994004d40 0x7f89ac13eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:23:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.109+0000 7f89b1200640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac1405c0 0x7f89ac13f440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f899800d8b0 tx=0x7f899800dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.110+0000 7f89a9600640 1 -- 172.21.15.142:0/3758471692 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998007480 con 0x7f89ac1405c0 2024-04-01T15:23:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.110+0000 7f89a9600640 1 -- 172.21.15.142:0/3758471692 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8998017070 con 0x7f89ac1405c0 2024-04-01T15:23:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.110+0000 7f89a9600640 1 -- 172.21.15.142:0/3758471692 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89980059a0 con 0x7f89ac1405c0 2024-04-01T15:23:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.110+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac1414b0 con 0x7f89ac1405c0 2024-04-01T15:23:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.110+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac071dc0 con 0x7f89ac1405c0 2024-04-01T15:23:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.111+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ac068590 con 0x7f89ac1405c0 2024-04-01T15:23:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.112+0000 7f89a9600640 1 -- 172.21.15.142:0/3758471692 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8998005b40 con 0x7f89ac1405c0 2024-04-01T15:23:56.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.113+0000 7f89a9600640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f898c06c8f0 0x7f898c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:23:56.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.113+0000 7f89a9600640 1 -- 172.21.15.142:0/3758471692 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f899808bdc0 con 0x7f89ac1405c0 2024-04-01T15:23:56.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.113+0000 7f89b1c00640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f898c06c8f0 0x7f898c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:23:56.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.115+0000 7f89b1c00640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f898c06c8f0 0x7f898c06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009a00 tx=0x7f89a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:23:56.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.117+0000 7f89a9600640 1 -- 172.21.15.142:0/3758471692 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8998007620 con 0x7f89ac1405c0 2024-04-01T15:23:56.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.316+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89ac151f00 con 0x7f898c06c8f0 2024-04-01T15:23:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.351+0000 7f89a9600640 1 -- 172.21.15.142:0/3758471692 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250881 (secure 0 0 0) 0x7f89ac151f00 con 0x7f898c06c8f0 2024-04-01T15:23:56.355 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:23:56.357 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:23:56.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.357+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f898c06c8f0 msgr2=0x7f898c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:56.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.357+0000 7f89b3000640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f898c06c8f0 0x7f898c06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009a00 tx=0x7f89a0008040 comp rx=0 tx=0).stop 2024-04-01T15:23:56.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.357+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac1405c0 msgr2=0x7f89ac13f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:23:56.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.357+0000 7f89b3000640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac1405c0 0x7f89ac13f440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f899800d8b0 tx=0x7f899800dd70 comp rx=0 tx=0).stop 2024-04-01T15:23:56.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.358+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 shutdown_connections 2024-04-01T15:23:56.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.358+0000 7f89b3000640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f898c06c8f0 0x7f898c06edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.358+0000 7f89b3000640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac132d50 0x7f89ac0707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.358+0000 7f89b3000640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac1405c0 0x7f89ac13f440 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.358+0000 7f89b3000640 1 --2- 172.21.15.142:0/3758471692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994004d40 0x7f89ac13eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:23:56.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.358+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 >> 172.21.15.142:0/3758471692 conn(0x7f89ac06c710 msgr2=0x7f89ac0b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:23:56.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.358+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 shutdown_connections 2024-04-01T15:23:56.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:23:56.358+0000 7f89b3000640 1 -- 172.21.15.142:0/3758471692 wait complete. 2024-04-01T15:23:56.378 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-01T15:23:54.604750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623758,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":246,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":3080,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":3153920,"data_stored":1912508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":30980,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":42,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008829"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747701+0000","last_change":"2024-04-01T15:21:58.539004+0000","last_active":"2024-04-01T15:22:39.747701+0000","last_peered":"2024-04-01T15:22:39.747701+0000","last_clean":"2024-04-01T15:22:39.747701+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:22:39.747701+0000","last_undegraded":"2024-04-01T15:22:39.747701+0000","last_fullsized":"2024-04-01T15:22:39.747701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737812+0000","last_change":"2024-04-01T15:21:58.524238+0000","last_active":"2024-04-01T15:22:39.737812+0000","last_peered":"2024-04-01T15:22:39.737812+0000","last_clean":"2024-04-01T15:22:39.737812+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:22:39.737812+0000","last_undegraded":"2024-04-01T15:22:39.737812+0000","last_fullsized":"2024-04-01T15:22:39.737812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748721+0000","last_change":"2024-04-01T15:21:58.526226+0000","last_active":"2024-04-01T15:22:39.748721+0000","last_peered":"2024-04-01T15:22:39.748721+0000","last_clean":"2024-04-01T15:22:39.748721+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:22:39.748721+0000","last_undegraded":"2024-04-01T15:22:39.748721+0000","last_fullsized":"2024-04-01T15:22:39.748721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732299+0000","last_change":"2024-04-01T15:21:58.541297+0000","last_active":"2024-04-01T15:22:39.732299+0000","last_peered":"2024-04-01T15:22:39.732299+0000","last_clean":"2024-04-01T15:22:39.732299+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:22:39.732299+0000","last_undegraded":"2024-04-01T15:22:39.732299+0000","last_fullsized":"2024-04-01T15:22:39.732299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747043+0000","last_change":"2024-04-01T15:21:58.518814+0000","last_active":"2024-04-01T15:22:39.747043+0000","last_peered":"2024-04-01T15:22:39.747043+0000","last_clean":"2024-04-01T15:22:39.747043+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:22:39.747043+0000","last_undegraded":"2024-04-01T15:22:39.747043+0000","last_fullsized":"2024-04-01T15:22:39.747043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:38:45.036533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:41.621921+0000","last_change":"2024-04-01T15:22:39.753380+0000","last_active":"2024-04-01T15:22:41.621921+0000","last_peered":"2024-04-01T15:22:41.621921+0000","last_clean":"2024-04-01T15:22:41.621921+0000","last_became_active":"2024-04-01T15:22:39.752359+0000","last_became_peered":"2024-04-01T15:22:39.752359+0000","last_unstale":"2024-04-01T15:22:41.621921+0000","last_undegraded":"2024-04-01T15:22:41.621921+0000","last_fullsized":"2024-04-01T15:22:41.621921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747048+0000","last_change":"2024-04-01T15:21:58.522961+0000","last_active":"2024-04-01T15:22:39.747048+0000","last_peered":"2024-04-01T15:22:39.747048+0000","last_clean":"2024-04-01T15:22:39.747048+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:22:39.747048+0000","last_undegraded":"2024-04-01T15:22:39.747048+0000","last_fullsized":"2024-04-01T15:22:39.747048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:51:33.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751116+0000","last_change":"2024-04-01T15:21:58.530231+0000","last_active":"2024-04-01T15:22:39.751116+0000","last_peered":"2024-04-01T15:22:39.751116+0000","last_clean":"2024-04-01T15:22:39.751116+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:22:39.751116+0000","last_undegraded":"2024-04-01T15:22:39.751116+0000","last_fullsized":"2024-04-01T15:22:39.751116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747834+0000","last_change":"2024-04-01T15:21:58.526959+0000","last_active":"2024-04-01T15:22:39.747834+0000","last_peered":"2024-04-01T15:22:39.747834+0000","last_clean":"2024-04-01T15:22:39.747834+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:22:39.747834+0000","last_undegraded":"2024-04-01T15:22:39.747834+0000","last_fullsized":"2024-04-01T15:22:39.747834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.733705+0000","last_change":"2024-04-01T15:21:58.529489+0000","last_active":"2024-04-01T15:22:39.733705+0000","last_peered":"2024-04-01T15:22:39.733705+0000","last_clean":"2024-04-01T15:22:39.733705+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:22:39.733705+0000","last_undegraded":"2024-04-01T15:22:39.733705+0000","last_fullsized":"2024-04-01T15:22:39.733705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734352+0000","last_change":"2024-04-01T15:21:58.527803+0000","last_active":"2024-04-01T15:22:39.734352+0000","last_peered":"2024-04-01T15:22:39.734352+0000","last_clean":"2024-04-01T15:22:39.734352+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:22:39.734352+0000","last_undegraded":"2024-04-01T15:22:39.734352+0000","last_fullsized":"2024-04-01T15:22:39.734352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748645+0000","last_change":"2024-04-01T15:21:58.535848+0000","last_active":"2024-04-01T15:22:39.748645+0000","last_peered":"2024-04-01T15:22:39.748645+0000","last_clean":"2024-04-01T15:22:39.748645+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:22:39.748645+0000","last_undegraded":"2024-04-01T15:22:39.748645+0000","last_fullsized":"2024-04-01T15:22:39.748645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:57.209359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752869+0000","last_change":"2024-04-01T15:21:58.528912+0000","last_active":"2024-04-01T15:22:39.752869+0000","last_peered":"2024-04-01T15:22:39.752869+0000","last_clean":"2024-04-01T15:22:39.752869+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:22:39.752869+0000","last_undegraded":"2024-04-01T15:22:39.752869+0000","last_fullsized":"2024-04-01T15:22:39.752869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'1","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:44.834368+0000","last_change":"2024-04-01T15:21:58.529847+0000","last_active":"2024-04-01T15:23:44.834368+0000","last_peered":"2024-04-01T15:23:44.834368+0000","last_clean":"2024-04-01T15:23:44.834368+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:23:44.834368+0000","last_undegraded":"2024-04-01T15:23:44.834368+0000","last_fullsized":"2024-04-01T15:23:44.834368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737854+0000","last_change":"2024-04-01T15:21:58.535414+0000","last_active":"2024-04-01T15:22:39.737854+0000","last_peered":"2024-04-01T15:22:39.737854+0000","last_clean":"2024-04-01T15:22:39.737854+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:22:39.737854+0000","last_undegraded":"2024-04-01T15:22:39.737854+0000","last_fullsized":"2024-04-01T15:22:39.737854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:44.665383+0000","last_change":"2024-04-01T15:21:58.522234+0000","last_active":"2024-04-01T15:23:44.665383+0000","last_peered":"2024-04-01T15:23:44.665383+0000","last_clean":"2024-04-01T15:23:44.665383+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:23:44.665383+0000","last_undegraded":"2024-04-01T15:23:44.665383+0000","last_fullsized":"2024-04-01T15:23:44.665383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732253+0000","last_change":"2024-04-01T15:21:58.531397+0000","last_active":"2024-04-01T15:22:39.732253+0000","last_peered":"2024-04-01T15:22:39.732253+0000","last_clean":"2024-04-01T15:22:39.732253+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:22:39.732253+0000","last_undegraded":"2024-04-01T15:22:39.732253+0000","last_fullsized":"2024-04-01T15:22:39.732253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728969+0000","last_change":"2024-04-01T15:21:58.522828+0000","last_active":"2024-04-01T15:22:39.728969+0000","last_peered":"2024-04-01T15:22:39.728969+0000","last_clean":"2024-04-01T15:22:39.728969+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:22:39.728969+0000","last_undegraded":"2024-04-01T15:22:39.728969+0000","last_fullsized":"2024-04-01T15:22:39.728969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747574+0000","last_change":"2024-04-01T15:21:58.532575+0000","last_active":"2024-04-01T15:22:39.747574+0000","last_peered":"2024-04-01T15:22:39.747574+0000","last_clean":"2024-04-01T15:22:39.747574+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:22:39.747574+0000","last_undegraded":"2024-04-01T15:22:39.747574+0000","last_fullsized":"2024-04-01T15:22:39.747574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731248+0000","last_change":"2024-04-01T15:21:58.530543+0000","last_active":"2024-04-01T15:22:39.731248+0000","last_peered":"2024-04-01T15:22:39.731248+0000","last_clean":"2024-04-01T15:22:39.731248+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:22:39.731248+0000","last_undegraded":"2024-04-01T15:22:39.731248+0000","last_fullsized":"2024-04-01T15:22:39.731248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:09:33.518173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748295+0000","last_change":"2024-04-01T15:21:58.528377+0000","last_active":"2024-04-01T15:22:39.748295+0000","last_peered":"2024-04-01T15:22:39.748295+0000","last_clean":"2024-04-01T15:22:39.748295+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:22:39.748295+0000","last_undegraded":"2024-04-01T15:22:39.748295+0000","last_fullsized":"2024-04-01T15:22:39.748295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731285+0000","last_change":"2024-04-01T15:21:58.530746+0000","last_active":"2024-04-01T15:22:39.731285+0000","last_peered":"2024-04-01T15:22:39.731285+0000","last_clean":"2024-04-01T15:22:39.731285+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:22:39.731285+0000","last_undegraded":"2024-04-01T15:22:39.731285+0000","last_fullsized":"2024-04-01T15:22:39.731285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749986+0000","last_change":"2024-04-01T15:21:58.516408+0000","last_active":"2024-04-01T15:22:39.749986+0000","last_peered":"2024-04-01T15:22:39.749986+0000","last_clean":"2024-04-01T15:22:39.749986+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:22:39.749986+0000","last_undegraded":"2024-04-01T15:22:39.749986+0000","last_fullsized":"2024-04-01T15:22:39.749986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731046+0000","last_change":"2024-04-01T15:21:58.525868+0000","last_active":"2024-04-01T15:22:39.731046+0000","last_peered":"2024-04-01T15:22:39.731046+0000","last_clean":"2024-04-01T15:22:39.731046+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:22:39.731046+0000","last_undegraded":"2024-04-01T15:22:39.731046+0000","last_fullsized":"2024-04-01T15:22:39.731046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754513+0000","last_change":"2024-04-01T15:21:58.531952+0000","last_active":"2024-04-01T15:22:39.754513+0000","last_peered":"2024-04-01T15:22:39.754513+0000","last_clean":"2024-04-01T15:22:39.754513+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:22:39.754513+0000","last_undegraded":"2024-04-01T15:22:39.754513+0000","last_fullsized":"2024-04-01T15:22:39.754513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.733953+0000","last_change":"2024-04-01T15:21:58.517341+0000","last_active":"2024-04-01T15:22:39.733953+0000","last_peered":"2024-04-01T15:22:39.733953+0000","last_clean":"2024-04-01T15:22:39.733953+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:22:39.733953+0000","last_undegraded":"2024-04-01T15:22:39.733953+0000","last_fullsized":"2024-04-01T15:22:39.733953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738009+0000","last_change":"2024-04-01T15:21:58.535087+0000","last_active":"2024-04-01T15:22:39.738009+0000","last_peered":"2024-04-01T15:22:39.738009+0000","last_clean":"2024-04-01T15:22:39.738009+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:22:39.738009+0000","last_undegraded":"2024-04-01T15:22:39.738009+0000","last_fullsized":"2024-04-01T15:22:39.738009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752727+0000","last_change":"2024-04-01T15:21:58.531487+0000","last_active":"2024-04-01T15:22:39.752727+0000","last_peered":"2024-04-01T15:22:39.752727+0000","last_clean":"2024-04-01T15:22:39.752727+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:22:39.752727+0000","last_undegraded":"2024-04-01T15:22:39.752727+0000","last_fullsized":"2024-04-01T15:22:39.752727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:40:57.921723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748304+0000","last_change":"2024-04-01T15:21:58.531305+0000","last_active":"2024-04-01T15:22:39.748304+0000","last_peered":"2024-04-01T15:22:39.748304+0000","last_clean":"2024-04-01T15:22:39.748304+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:22:39.748304+0000","last_undegraded":"2024-04-01T15:22:39.748304+0000","last_fullsized":"2024-04-01T15:22:39.748304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731539+0000","last_change":"2024-04-01T15:21:58.530998+0000","last_active":"2024-04-01T15:22:39.731539+0000","last_peered":"2024-04-01T15:22:39.731539+0000","last_clean":"2024-04-01T15:22:39.731539+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:22:39.731539+0000","last_undegraded":"2024-04-01T15:22:39.731539+0000","last_fullsized":"2024-04-01T15:22:39.731539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728756+0000","last_change":"2024-04-01T15:21:58.523119+0000","last_active":"2024-04-01T15:22:39.728756+0000","last_peered":"2024-04-01T15:22:39.728756+0000","last_clean":"2024-04-01T15:22:39.728756+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:22:39.728756+0000","last_undegraded":"2024-04-01T15:22:39.728756+0000","last_fullsized":"2024-04-01T15:22:39.728756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.730767+0000","last_change":"2024-04-01T15:21:58.514302+0000","last_active":"2024-04-01T15:22:39.730767+0000","last_peered":"2024-04-01T15:22:39.730767+0000","last_clean":"2024-04-01T15:22:39.730767+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:22:39.730767+0000","last_undegraded":"2024-04-01T15:22:39.730767+0000","last_fullsized":"2024-04-01T15:22:39.730767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:59:46.312407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748155+0000","last_change":"2024-04-01T15:21:58.528525+0000","last_active":"2024-04-01T15:22:39.748155+0000","last_peered":"2024-04-01T15:22:39.748155+0000","last_clean":"2024-04-01T15:22:39.748155+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:22:39.748155+0000","last_undegraded":"2024-04-01T15:22:39.748155+0000","last_fullsized":"2024-04-01T15:22:39.748155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:58.054203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.753403+0000","last_change":"2024-04-01T15:21:57.523557+0000","last_active":"2024-04-01T15:22:39.753403+0000","last_peered":"2024-04-01T15:22:39.753403+0000","last_clean":"2024-04-01T15:22:39.753403+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:22:39.753403+0000","last_undegraded":"2024-04-01T15:22:39.753403+0000","last_fullsized":"2024-04-01T15:22:39.753403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748664+0000","last_change":"2024-04-01T15:21:58.531570+0000","last_active":"2024-04-01T15:22:39.748664+0000","last_peered":"2024-04-01T15:22:39.748664+0000","last_clean":"2024-04-01T15:22:39.748664+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:22:39.748664+0000","last_undegraded":"2024-04-01T15:22:39.748664+0000","last_fullsized":"2024-04-01T15:22:39.748664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732276+0000","last_change":"2024-04-01T15:21:57.519248+0000","last_active":"2024-04-01T15:22:39.732276+0000","last_peered":"2024-04-01T15:22:39.732276+0000","last_clean":"2024-04-01T15:22:39.732276+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:22:39.732276+0000","last_undegraded":"2024-04-01T15:22:39.732276+0000","last_fullsized":"2024-04-01T15:22:39.732276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751667+0000","last_change":"2024-04-01T15:21:57.518727+0000","last_active":"2024-04-01T15:22:39.751667+0000","last_peered":"2024-04-01T15:22:39.751667+0000","last_clean":"2024-04-01T15:22:39.751667+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:22:39.751667+0000","last_undegraded":"2024-04-01T15:22:39.751667+0000","last_fullsized":"2024-04-01T15:22:39.751667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:15:36.993209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752004+0000","last_change":"2024-04-01T15:21:58.527894+0000","last_active":"2024-04-01T15:22:39.752004+0000","last_peered":"2024-04-01T15:22:39.752004+0000","last_clean":"2024-04-01T15:22:39.752004+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:22:39.752004+0000","last_undegraded":"2024-04-01T15:22:39.752004+0000","last_fullsized":"2024-04-01T15:22:39.752004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:12:13.182210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731247+0000","last_change":"2024-04-01T15:21:57.534982+0000","last_active":"2024-04-01T15:22:39.731247+0000","last_peered":"2024-04-01T15:22:39.731247+0000","last_clean":"2024-04-01T15:22:39.731247+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:22:39.731247+0000","last_undegraded":"2024-04-01T15:22:39.731247+0000","last_fullsized":"2024-04-01T15:22:39.731247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737338+0000","last_change":"2024-04-01T15:21:58.525017+0000","last_active":"2024-04-01T15:22:39.737338+0000","last_peered":"2024-04-01T15:22:39.737338+0000","last_clean":"2024-04-01T15:22:39.737338+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:22:39.737338+0000","last_undegraded":"2024-04-01T15:22:39.737338+0000","last_fullsized":"2024-04-01T15:22:39.737338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734653+0000","last_change":"2024-04-01T15:21:57.528840+0000","last_active":"2024-04-01T15:22:39.734653+0000","last_peered":"2024-04-01T15:22:39.734653+0000","last_clean":"2024-04-01T15:22:39.734653+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:22:39.734653+0000","last_undegraded":"2024-04-01T15:22:39.734653+0000","last_fullsized":"2024-04-01T15:22:39.734653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732656+0000","last_change":"2024-04-01T15:21:58.529422+0000","last_active":"2024-04-01T15:22:39.732656+0000","last_peered":"2024-04-01T15:22:39.732656+0000","last_clean":"2024-04-01T15:22:39.732656+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:22:39.732656+0000","last_undegraded":"2024-04-01T15:22:39.732656+0000","last_fullsized":"2024-04-01T15:22:39.732656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:25:56.472310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732852+0000","last_change":"2024-04-01T15:21:57.528345+0000","last_active":"2024-04-01T15:22:39.732852+0000","last_peered":"2024-04-01T15:22:39.732852+0000","last_clean":"2024-04-01T15:22:39.732852+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:22:39.732852+0000","last_undegraded":"2024-04-01T15:22:39.732852+0000","last_fullsized":"2024-04-01T15:22:39.732852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749919+0000","last_change":"2024-04-01T15:21:58.529376+0000","last_active":"2024-04-01T15:22:39.749919+0000","last_peered":"2024-04-01T15:22:39.749919+0000","last_clean":"2024-04-01T15:22:39.749919+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:22:39.749919+0000","last_undegraded":"2024-04-01T15:22:39.749919+0000","last_fullsized":"2024-04-01T15:22:39.749919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'5","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:45.692220+0000","last_change":"2024-04-01T15:21:57.526610+0000","last_active":"2024-04-01T15:23:45.692220+0000","last_peered":"2024-04-01T15:23:45.692220+0000","last_clean":"2024-04-01T15:23:45.692220+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:23:45.692220+0000","last_undegraded":"2024-04-01T15:23:45.692220+0000","last_fullsized":"2024-04-01T15:23:45.692220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748837+0000","last_change":"2024-04-01T15:21:58.537476+0000","last_active":"2024-04-01T15:22:39.748837+0000","last_peered":"2024-04-01T15:22:39.748837+0000","last_clean":"2024-04-01T15:22:39.748837+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:22:39.748837+0000","last_undegraded":"2024-04-01T15:22:39.748837+0000","last_fullsized":"2024-04-01T15:22:39.748837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:38:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'36","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:45.674545+0000","last_change":"2024-04-01T15:21:57.513766+0000","last_active":"2024-04-01T15:23:45.674545+0000","last_peered":"2024-04-01T15:23:45.674545+0000","last_clean":"2024-04-01T15:23:45.674545+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:23:45.674545+0000","last_undegraded":"2024-04-01T15:23:45.674545+0000","last_fullsized":"2024-04-01T15:23:45.674545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32289,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747415+0000","last_change":"2024-04-01T15:21:58.539751+0000","last_active":"2024-04-01T15:22:39.747415+0000","last_peered":"2024-04-01T15:22:39.747415+0000","last_clean":"2024-04-01T15:22:39.747415+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:22:39.747415+0000","last_undegraded":"2024-04-01T15:22:39.747415+0000","last_fullsized":"2024-04-01T15:22:39.747415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:02.390379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:50.243580+0000","last_change":"2024-04-01T15:23:50.243626+0000","last_active":"2024-04-01T15:23:50.243580+0000","last_peered":"2024-04-01T15:23:50.243580+0000","last_clean":"2024-04-01T15:23:50.243580+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:23:50.243580+0000","last_undegraded":"2024-04-01T15:23:50.243580+0000","last_fullsized":"2024-04-01T15:23:50.243580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-01T15:23:50.243445+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-01T15:23:50.243445+0000","last_clean_scrub_stamp":"2024-04-01T15:23:50.243445+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:44:32.602587+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'1","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:45.687975+0000","last_change":"2024-04-01T15:21:58.532249+0000","last_active":"2024-04-01T15:23:45.687975+0000","last_peered":"2024-04-01T15:23:45.687975+0000","last_clean":"2024-04-01T15:23:45.687975+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:23:45.687975+0000","last_undegraded":"2024-04-01T15:23:45.687975+0000","last_fullsized":"2024-04-01T15:23:45.687975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731604+0000","last_change":"2024-04-01T15:21:57.528780+0000","last_active":"2024-04-01T15:22:39.731604+0000","last_peered":"2024-04-01T15:22:39.731604+0000","last_clean":"2024-04-01T15:22:39.731604+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:22:39.731604+0000","last_undegraded":"2024-04-01T15:22:39.731604+0000","last_fullsized":"2024-04-01T15:22:39.731604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747190+0000","last_change":"2024-04-01T15:21:58.528458+0000","last_active":"2024-04-01T15:22:39.747190+0000","last_peered":"2024-04-01T15:22:39.747190+0000","last_clean":"2024-04-01T15:22:39.747190+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:22:39.747190+0000","last_undegraded":"2024-04-01T15:22:39.747190+0000","last_fullsized":"2024-04-01T15:22:39.747190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:31.178436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731732+0000","last_change":"2024-04-01T15:21:57.528026+0000","last_active":"2024-04-01T15:22:39.731732+0000","last_peered":"2024-04-01T15:22:39.731732+0000","last_clean":"2024-04-01T15:22:39.731732+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:22:39.731732+0000","last_undegraded":"2024-04-01T15:22:39.731732+0000","last_fullsized":"2024-04-01T15:22:39.731732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:01:36.189109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731062+0000","last_change":"2024-04-01T15:21:58.514047+0000","last_active":"2024-04-01T15:22:39.731062+0000","last_peered":"2024-04-01T15:22:39.731062+0000","last_clean":"2024-04-01T15:22:39.731062+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:22:39.731062+0000","last_undegraded":"2024-04-01T15:22:39.731062+0000","last_fullsized":"2024-04-01T15:22:39.731062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:17:11.003191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.728579+0000","last_change":"2024-04-01T15:21:57.517184+0000","last_active":"2024-04-01T15:22:39.728579+0000","last_peered":"2024-04-01T15:22:39.728579+0000","last_clean":"2024-04-01T15:22:39.728579+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:22:39.728579+0000","last_undegraded":"2024-04-01T15:22:39.728579+0000","last_fullsized":"2024-04-01T15:22:39.728579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746976+0000","last_change":"2024-04-01T15:21:58.529946+0000","last_active":"2024-04-01T15:22:39.746976+0000","last_peered":"2024-04-01T15:22:39.746976+0000","last_clean":"2024-04-01T15:22:39.746976+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:22:39.746976+0000","last_undegraded":"2024-04-01T15:22:39.746976+0000","last_fullsized":"2024-04-01T15:22:39.746976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:49:53.657475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748524+0000","last_change":"2024-04-01T15:21:57.519642+0000","last_active":"2024-04-01T15:22:39.748524+0000","last_peered":"2024-04-01T15:22:39.748524+0000","last_clean":"2024-04-01T15:22:39.748524+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:22:39.748524+0000","last_undegraded":"2024-04-01T15:22:39.748524+0000","last_fullsized":"2024-04-01T15:22:39.748524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:09:07.894019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747731+0000","last_change":"2024-04-01T15:21:58.529121+0000","last_active":"2024-04-01T15:22:39.747731+0000","last_peered":"2024-04-01T15:22:39.747731+0000","last_clean":"2024-04-01T15:22:39.747731+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:22:39.747731+0000","last_undegraded":"2024-04-01T15:22:39.747731+0000","last_fullsized":"2024-04-01T15:22:39.747731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.729403+0000","last_change":"2024-04-01T15:21:57.514455+0000","last_active":"2024-04-01T15:22:39.729403+0000","last_peered":"2024-04-01T15:22:39.729403+0000","last_clean":"2024-04-01T15:22:39.729403+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:22:39.729403+0000","last_undegraded":"2024-04-01T15:22:39.729403+0000","last_fullsized":"2024-04-01T15:22:39.729403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747837+0000","last_change":"2024-04-01T15:21:58.535610+0000","last_active":"2024-04-01T15:22:39.747837+0000","last_peered":"2024-04-01T15:22:39.747837+0000","last_clean":"2024-04-01T15:22:39.747837+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:22:39.747837+0000","last_undegraded":"2024-04-01T15:22:39.747837+0000","last_fullsized":"2024-04-01T15:22:39.747837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.738193+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:22:39.738193+0000","last_peered":"2024-04-01T15:22:39.738193+0000","last_clean":"2024-04-01T15:22:39.738193+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:22:39.738193+0000","last_undegraded":"2024-04-01T15:22:39.738193+0000","last_fullsized":"2024-04-01T15:22:39.738193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.740524+0000","last_change":"2024-04-01T15:22:39.740524+0000","last_active":"2024-04-01T15:22:39.740524+0000","last_peered":"2024-04-01T15:22:39.740524+0000","last_clean":"2024-04-01T15:22:39.740524+0000","last_became_active":"2024-04-01T15:22:39.739729+0000","last_became_peered":"2024-04-01T15:22:39.739729+0000","last_unstale":"2024-04-01T15:22:39.740524+0000","last_undegraded":"2024-04-01T15:22:39.740524+0000","last_fullsized":"2024-04-01T15:22:39.740524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:42.451490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.729473+0000","last_change":"2024-04-01T15:21:57.532167+0000","last_active":"2024-04-01T15:22:39.729473+0000","last_peered":"2024-04-01T15:22:39.729473+0000","last_clean":"2024-04-01T15:22:39.729473+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:22:39.729473+0000","last_undegraded":"2024-04-01T15:22:39.729473+0000","last_fullsized":"2024-04-01T15:22:39.729473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:41.621500+0000","last_change":"2024-04-01T15:22:39.741396+0000","last_active":"2024-04-01T15:22:41.621500+0000","last_peered":"2024-04-01T15:22:41.621500+0000","last_clean":"2024-04-01T15:22:41.621500+0000","last_became_active":"2024-04-01T15:22:39.740443+0000","last_became_peered":"2024-04-01T15:22:39.740443+0000","last_unstale":"2024-04-01T15:22:41.621500+0000","last_undegraded":"2024-04-01T15:22:41.621500+0000","last_fullsized":"2024-04-01T15:22:41.621500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746968+0000","last_change":"2024-04-01T15:21:47.878530+0000","last_active":"2024-04-01T15:22:39.746968+0000","last_peered":"2024-04-01T15:22:39.746968+0000","last_clean":"2024-04-01T15:22:39.746968+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:22:39.746968+0000","last_undegraded":"2024-04-01T15:22:39.746968+0000","last_fullsized":"2024-04-01T15:22:39.746968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:46.852307+0000","last_clean_scrub_stamp":"2024-04-01T15:21:46.852307+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:25:18.137507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731374+0000","last_change":"2024-04-01T15:21:57.530394+0000","last_active":"2024-04-01T15:22:39.731374+0000","last_peered":"2024-04-01T15:22:39.731374+0000","last_clean":"2024-04-01T15:22:39.731374+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:22:39.731374+0000","last_undegraded":"2024-04-01T15:22:39.731374+0000","last_fullsized":"2024-04-01T15:22:39.731374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:55:30.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.752344+0000","last_change":"2024-04-01T15:21:58.529751+0000","last_active":"2024-04-01T15:22:39.752344+0000","last_peered":"2024-04-01T15:22:39.752344+0000","last_clean":"2024-04-01T15:22:39.752344+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:22:39.752344+0000","last_undegraded":"2024-04-01T15:22:39.752344+0000","last_fullsized":"2024-04-01T15:22:39.752344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:42:56.911104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746918+0000","last_change":"2024-04-01T15:21:57.526919+0000","last_active":"2024-04-01T15:22:39.746918+0000","last_peered":"2024-04-01T15:22:39.746918+0000","last_clean":"2024-04-01T15:22:39.746918+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:22:39.746918+0000","last_undegraded":"2024-04-01T15:22:39.746918+0000","last_fullsized":"2024-04-01T15:22:39.746918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747812+0000","last_change":"2024-04-01T15:21:58.525329+0000","last_active":"2024-04-01T15:22:39.747812+0000","last_peered":"2024-04-01T15:22:39.747812+0000","last_clean":"2024-04-01T15:22:39.747812+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:22:39.747812+0000","last_undegraded":"2024-04-01T15:22:39.747812+0000","last_fullsized":"2024-04-01T15:22:39.747812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:51.444000+0000","last_change":"2024-04-01T15:23:51.444029+0000","last_active":"2024-04-01T15:23:51.444000+0000","last_peered":"2024-04-01T15:23:51.444000+0000","last_clean":"2024-04-01T15:23:51.444000+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:23:51.444000+0000","last_undegraded":"2024-04-01T15:23:51.444000+0000","last_fullsized":"2024-04-01T15:23:51.444000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-01T15:23:51.443897+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-01T15:23:51.443897+0000","last_clean_scrub_stamp":"2024-04-01T15:23:51.443897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:52:36.422881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737185+0000","last_change":"2024-04-01T15:21:58.523794+0000","last_active":"2024-04-01T15:22:39.737185+0000","last_peered":"2024-04-01T15:22:39.737185+0000","last_clean":"2024-04-01T15:22:39.737185+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:22:39.737185+0000","last_undegraded":"2024-04-01T15:22:39.737185+0000","last_fullsized":"2024-04-01T15:22:39.737185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.731803+0000","last_change":"2024-04-01T15:21:57.527763+0000","last_active":"2024-04-01T15:22:39.731803+0000","last_peered":"2024-04-01T15:22:39.731803+0000","last_clean":"2024-04-01T15:22:39.731803+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:22:39.731803+0000","last_undegraded":"2024-04-01T15:22:39.731803+0000","last_fullsized":"2024-04-01T15:22:39.731803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:49.928981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.748426+0000","last_change":"2024-04-01T15:21:58.531026+0000","last_active":"2024-04-01T15:22:39.748426+0000","last_peered":"2024-04-01T15:22:39.748426+0000","last_clean":"2024-04-01T15:22:39.748426+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:22:39.748426+0000","last_undegraded":"2024-04-01T15:22:39.748426+0000","last_fullsized":"2024-04-01T15:22:39.748426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:50.706762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:51.231687+0000","last_change":"2024-04-01T15:23:51.231722+0000","last_active":"2024-04-01T15:23:51.231687+0000","last_peered":"2024-04-01T15:23:51.231687+0000","last_clean":"2024-04-01T15:23:51.231687+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:23:51.231687+0000","last_undegraded":"2024-04-01T15:23:51.231687+0000","last_fullsized":"2024-04-01T15:23:51.231687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:51.231573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:51.231573+0000","last_clean_scrub_stamp":"2024-04-01T15:23:51.231573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:44:33.590716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732520+0000","last_change":"2024-04-01T15:21:58.541348+0000","last_active":"2024-04-01T15:22:39.732520+0000","last_peered":"2024-04-01T15:22:39.732520+0000","last_clean":"2024-04-01T15:22:39.732520+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:22:39.732520+0000","last_undegraded":"2024-04-01T15:22:39.732520+0000","last_fullsized":"2024-04-01T15:22:39.732520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:46:19.379950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747695+0000","last_change":"2024-04-01T15:21:57.526914+0000","last_active":"2024-04-01T15:22:39.747695+0000","last_peered":"2024-04-01T15:22:39.747695+0000","last_clean":"2024-04-01T15:22:39.747695+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:22:39.747695+0000","last_undegraded":"2024-04-01T15:22:39.747695+0000","last_fullsized":"2024-04-01T15:22:39.747695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:11:56.195114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737560+0000","last_change":"2024-04-01T15:21:58.515834+0000","last_active":"2024-04-01T15:22:39.737560+0000","last_peered":"2024-04-01T15:22:39.737560+0000","last_clean":"2024-04-01T15:22:39.737560+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:22:39.737560+0000","last_undegraded":"2024-04-01T15:22:39.737560+0000","last_fullsized":"2024-04-01T15:22:39.737560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:48.523648+0000","last_change":"2024-04-01T15:21:57.533452+0000","last_active":"2024-04-01T15:23:48.523648+0000","last_peered":"2024-04-01T15:23:48.523648+0000","last_clean":"2024-04-01T15:23:48.523648+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:23:48.523648+0000","last_undegraded":"2024-04-01T15:23:48.523648+0000","last_fullsized":"2024-04-01T15:23:48.523648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:44.722912+0000","last_change":"2024-04-01T15:21:58.512191+0000","last_active":"2024-04-01T15:23:44.722912+0000","last_peered":"2024-04-01T15:23:44.722912+0000","last_clean":"2024-04-01T15:23:44.722912+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:23:44.722912+0000","last_undegraded":"2024-04-01T15:23:44.722912+0000","last_fullsized":"2024-04-01T15:23:44.722912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:11.642843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.734713+0000","last_change":"2024-04-01T15:21:57.526196+0000","last_active":"2024-04-01T15:22:39.734713+0000","last_peered":"2024-04-01T15:22:39.734713+0000","last_clean":"2024-04-01T15:22:39.734713+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:22:39.734713+0000","last_undegraded":"2024-04-01T15:22:39.734713+0000","last_fullsized":"2024-04-01T15:22:39.734713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749557+0000","last_change":"2024-04-01T15:21:58.526739+0000","last_active":"2024-04-01T15:22:39.749557+0000","last_peered":"2024-04-01T15:22:39.749557+0000","last_clean":"2024-04-01T15:22:39.749557+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:22:39.749557+0000","last_undegraded":"2024-04-01T15:22:39.749557+0000","last_fullsized":"2024-04-01T15:22:39.749557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.746750+0000","last_change":"2024-04-01T15:21:57.526924+0000","last_active":"2024-04-01T15:22:39.746750+0000","last_peered":"2024-04-01T15:22:39.746750+0000","last_clean":"2024-04-01T15:22:39.746750+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:22:39.746750+0000","last_undegraded":"2024-04-01T15:22:39.746750+0000","last_fullsized":"2024-04-01T15:22:39.746750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:44:59.822698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749243+0000","last_change":"2024-04-01T15:21:58.528396+0000","last_active":"2024-04-01T15:22:39.749243+0000","last_peered":"2024-04-01T15:22:39.749243+0000","last_clean":"2024-04-01T15:22:39.749243+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:22:39.749243+0000","last_undegraded":"2024-04-01T15:22:39.749243+0000","last_fullsized":"2024-04-01T15:22:39.749243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:38:50.943225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737662+0000","last_change":"2024-04-01T15:21:57.523643+0000","last_active":"2024-04-01T15:22:39.737662+0000","last_peered":"2024-04-01T15:22:39.737662+0000","last_clean":"2024-04-01T15:22:39.737662+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:22:39.737662+0000","last_undegraded":"2024-04-01T15:22:39.737662+0000","last_fullsized":"2024-04-01T15:22:39.737662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.751390+0000","last_change":"2024-04-01T15:21:58.529955+0000","last_active":"2024-04-01T15:22:39.751390+0000","last_peered":"2024-04-01T15:22:39.751390+0000","last_clean":"2024-04-01T15:22:39.751390+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:22:39.751390+0000","last_undegraded":"2024-04-01T15:22:39.751390+0000","last_fullsized":"2024-04-01T15:22:39.751390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.737925+0000","last_change":"2024-04-01T15:21:57.526620+0000","last_active":"2024-04-01T15:22:39.737925+0000","last_peered":"2024-04-01T15:22:39.737925+0000","last_clean":"2024-04-01T15:22:39.737925+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:22:39.737925+0000","last_undegraded":"2024-04-01T15:22:39.737925+0000","last_fullsized":"2024-04-01T15:22:39.737925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.753152+0000","last_change":"2024-04-01T15:21:58.534484+0000","last_active":"2024-04-01T15:22:39.753152+0000","last_peered":"2024-04-01T15:22:39.753152+0000","last_clean":"2024-04-01T15:22:39.753152+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:22:39.753152+0000","last_undegraded":"2024-04-01T15:22:39.753152+0000","last_fullsized":"2024-04-01T15:22:39.753152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:43:41.465010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747437+0000","last_change":"2024-04-01T15:21:57.531639+0000","last_active":"2024-04-01T15:22:39.747437+0000","last_peered":"2024-04-01T15:22:39.747437+0000","last_clean":"2024-04-01T15:22:39.747437+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:22:39.747437+0000","last_undegraded":"2024-04-01T15:22:39.747437+0000","last_fullsized":"2024-04-01T15:22:39.747437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:57.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732012+0000","last_change":"2024-04-01T15:21:58.523366+0000","last_active":"2024-04-01T15:22:39.732012+0000","last_peered":"2024-04-01T15:22:39.732012+0000","last_clean":"2024-04-01T15:22:39.732012+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:22:39.732012+0000","last_undegraded":"2024-04-01T15:22:39.732012+0000","last_fullsized":"2024-04-01T15:22:39.732012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:03.565631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.732440+0000","last_change":"2024-04-01T15:21:58.526457+0000","last_active":"2024-04-01T15:22:39.732440+0000","last_peered":"2024-04-01T15:22:39.732440+0000","last_clean":"2024-04-01T15:22:39.732440+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:22:39.732440+0000","last_undegraded":"2024-04-01T15:22:39.732440+0000","last_fullsized":"2024-04-01T15:22:39.732440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:56:13.122547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747278+0000","last_change":"2024-04-01T15:21:57.534510+0000","last_active":"2024-04-01T15:22:39.747278+0000","last_peered":"2024-04-01T15:22:39.747278+0000","last_clean":"2024-04-01T15:22:39.747278+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:22:39.747278+0000","last_undegraded":"2024-04-01T15:22:39.747278+0000","last_fullsized":"2024-04-01T15:22:39.747278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:38:49.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:41.621979+0000","last_change":"2024-04-01T15:22:39.750841+0000","last_active":"2024-04-01T15:22:41.621979+0000","last_peered":"2024-04-01T15:22:41.621979+0000","last_clean":"2024-04-01T15:22:41.621979+0000","last_became_active":"2024-04-01T15:22:39.750255+0000","last_became_peered":"2024-04-01T15:22:39.750255+0000","last_unstale":"2024-04-01T15:22:41.621979+0000","last_undegraded":"2024-04-01T15:22:41.621979+0000","last_fullsized":"2024-04-01T15:22:41.621979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747605+0000","last_change":"2024-04-01T15:21:57.533797+0000","last_active":"2024-04-01T15:22:39.747605+0000","last_peered":"2024-04-01T15:22:39.747605+0000","last_clean":"2024-04-01T15:22:39.747605+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:22:39.747605+0000","last_undegraded":"2024-04-01T15:22:39.747605+0000","last_fullsized":"2024-04-01T15:22:39.747605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:16:16.205030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.749291+0000","last_change":"2024-04-01T15:21:58.524922+0000","last_active":"2024-04-01T15:22:39.749291+0000","last_peered":"2024-04-01T15:22:39.749291+0000","last_clean":"2024-04-01T15:22:39.749291+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:22:39.749291+0000","last_undegraded":"2024-04-01T15:22:39.749291+0000","last_fullsized":"2024-04-01T15:22:39.749291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754618+0000","last_change":"2024-04-01T15:21:57.518934+0000","last_active":"2024-04-01T15:22:39.754618+0000","last_peered":"2024-04-01T15:22:39.754618+0000","last_clean":"2024-04-01T15:22:39.754618+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:22:39.754618+0000","last_undegraded":"2024-04-01T15:22:39.754618+0000","last_fullsized":"2024-04-01T15:22:39.754618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:56.458262+0000","last_clean_scrub_stamp":"2024-04-01T15:21:56.458262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:33.708208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.754328+0000","last_change":"2024-04-01T15:21:58.538259+0000","last_active":"2024-04-01T15:22:39.754328+0000","last_peered":"2024-04-01T15:22:39.754328+0000","last_clean":"2024-04-01T15:22:39.754328+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:22:39.754328+0000","last_undegraded":"2024-04-01T15:22:39.754328+0000","last_fullsized":"2024-04-01T15:22:39.754328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:47:33.675579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'6","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:51.218446+0000","last_change":"2024-04-01T15:23:51.218476+0000","last_active":"2024-04-01T15:23:51.218446+0000","last_peered":"2024-04-01T15:23:51.218446+0000","last_clean":"2024-04-01T15:23:51.218446+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:23:51.218446+0000","last_undegraded":"2024-04-01T15:23:51.218446+0000","last_fullsized":"2024-04-01T15:23:51.218446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-01T15:23:51.218306+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-01T15:23:51.218306+0000","last_clean_scrub_stamp":"2024-04-01T15:23:51.218306+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:19:38.238216+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":33390,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":81,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":66780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":827392,"data_stored":674074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":115413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":83214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":83250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":115716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":674130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":32289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:23:56.385 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.385 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.385 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.385 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.385 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.385 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.386 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.386 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.386 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.386 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.386 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.386 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.387 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.387 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.387 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.387 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.387 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.387 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.387 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.388 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.388 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.388 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.388 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.388 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.388 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.389 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.389 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.389 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.389 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.389 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.389 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.390 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.390 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.390 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.390 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.390 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.390 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.390 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.391 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.391 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.391 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.391 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.391 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.391 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.392 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.392 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.392 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.392 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.392 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.392 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.392 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.393 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.393 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.393 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.393 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.393 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.393 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.393 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.394 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.394 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.394 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.394 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.394 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.394 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-01T15:21:46.852307+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=46, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.395 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.395 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.395 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.395 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.395 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.395 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.396 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.396 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.396 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.396 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.396 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.396 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.396 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.397 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.397 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.397 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.397 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.397 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.397 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.398 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.398 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.398 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.398 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.398 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.398 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.398 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.399 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.399 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-01T15:21:56.458262+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=56, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.399 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:23:56.399 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-01T15:24:16.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:24:16.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.614+0000 7fd285200640 1 Processor -- start 2024-04-01T15:24:16.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.614+0000 7fd285200640 1 -- start start 2024-04-01T15:24:16.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.615+0000 7fd285200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2800b5d50 0x7fd28014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:16.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.615+0000 7fd285200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd28014f820 0x7fd28014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:16.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.615+0000 7fd285200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2800afad0 con 0x7fd2800b5970 2024-04-01T15:24:16.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.615+0000 7fd285200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd2800afd40 con 0x7fd28014f820 2024-04-01T15:24:16.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.615+0000 7fd285200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd2800b5570 con 0x7fd2800b5d50 2024-04-01T15:24:16.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.616+0000 7fd27fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd28014f820 0x7fd28014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:16.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.616+0000 7fd27fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd28014f820 0x7fd28014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44924/0 (socket says 172.21.15.142:44924) 2024-04-01T15:24:16.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.616+0000 7fd27fe00640 1 -- 172.21.15.142:0/2943051100 learned_addr learned my addr 172.21.15.142:0/2943051100 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:16.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.616+0000 7fd27ea00640 1 --2- 172.21.15.142:0/2943051100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2800b5d50 0x7fd28014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:16.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.616+0000 7fd27fe00640 1 -- 172.21.15.142:0/2943051100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2800b5d50 msgr2=0x7fd28014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:16.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.616+0000 7fd27fe00640 1 --2- 172.21.15.142:0/2943051100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2800b5d50 0x7fd28014f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.616+0000 7fd27fe00640 1 -- 172.21.15.142:0/2943051100 >> v1:172.21.15.179:6789/0 conn(0x7fd2800b5970 legacy=0x7fd2800ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:16.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.616+0000 7fd27fe00640 1 -- 172.21.15.142:0/2943051100 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2800b4db0 con 0x7fd28014f820 2024-04-01T15:24:16.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.617+0000 7fd27fe00640 1 --2- 172.21.15.142:0/2943051100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd28014f820 0x7fd28014fcb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd278009e50 tx=0x7fd27802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de61b58a4843c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:16.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.618+0000 7fd27e000640 1 -- 172.21.15.142:0/2943051100 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27802c9e0 con 0x7fd28014f820 2024-04-01T15:24:16.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.618+0000 7fd27e000640 1 -- 172.21.15.142:0/2943051100 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27802cb80 con 0x7fd28014f820 2024-04-01T15:24:16.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.618+0000 7fd27e000640 1 -- 172.21.15.142:0/2943051100 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2780343f0 con 0x7fd28014f820 2024-04-01T15:24:16.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.618+0000 7fd285200640 1 -- 172.21.15.142:0/2943051100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd28014f820 msgr2=0x7fd28014fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:16.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.618+0000 7fd285200640 1 --2- 172.21.15.142:0/2943051100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd28014f820 0x7fd28014fcb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd278009e50 tx=0x7fd27802be40 comp rx=0 tx=0).stop 2024-04-01T15:24:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.618+0000 7fd285200640 1 -- 172.21.15.142:0/2943051100 shutdown_connections 2024-04-01T15:24:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.618+0000 7fd285200640 1 --2- 172.21.15.142:0/2943051100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd28014f820 0x7fd28014fcb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.618+0000 7fd285200640 1 --2- 172.21.15.142:0/2943051100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2800b5d50 0x7fd28014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.618+0000 7fd285200640 1 -- 172.21.15.142:0/2943051100 >> 172.21.15.142:0/2943051100 conn(0x7fd28006c710 msgr2=0x7fd28006cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.619+0000 7fd285200640 1 -- 172.21.15.142:0/2943051100 shutdown_connections 2024-04-01T15:24:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.619+0000 7fd285200640 1 -- 172.21.15.142:0/2943051100 wait complete. 2024-04-01T15:24:16.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.620+0000 7fd285200640 1 Processor -- start 2024-04-01T15:24:16.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.620+0000 7fd285200640 1 -- start start 2024-04-01T15:24:16.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.621+0000 7fd285200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2800b5970 0x7fd2801d4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:16.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.621+0000 7fd285200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2800b5d50 0x7fd2801e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:16.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.621+0000 7fd285200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd28014f820 0x7fd2801e12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:16.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.621+0000 7fd285200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd2800b5050 con 0x7fd2800b5970 2024-04-01T15:24:16.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.621+0000 7fd285200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd28009ee80 con 0x7fd2800b5d50 2024-04-01T15:24:16.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.621+0000 7fd285200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd2800aeca0 con 0x7fd28014f820 2024-04-01T15:24:16.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.621+0000 7fd27f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2800b5970 0x7fd2801d4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:16.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.621+0000 7fd27f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2800b5970 0x7fd2801d4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44932/0 (socket says 172.21.15.142:44932) 2024-04-01T15:24:16.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.621+0000 7fd27f400640 1 -- 172.21.15.142:0/730763805 learned_addr learned my addr 172.21.15.142:0/730763805 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:16.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd27fe00640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd28014f820 0x7fd2801e12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:16.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd27ea00640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2800b5d50 0x7fd2801e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:16.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd27f400640 1 -- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd28014f820 msgr2=0x7fd2801e12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:16.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd27f400640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd28014f820 0x7fd2801e12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd27f400640 1 -- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2800b5d50 msgr2=0x7fd2801e4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:16.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd27f400640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2800b5d50 0x7fd2801e4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd27f400640 1 -- 172.21.15.142:0/730763805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2801d6510 con 0x7fd2800b5970 2024-04-01T15:24:16.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd27fe00640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd28014f820 0x7fd2801e12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:24:16.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd27f400640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2800b5970 0x7fd2801d4fc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c3f0 tx=0x7fd27000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:16.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd277400640 1 -- 172.21.15.142:0/730763805 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2700052d0 con 0x7fd2800b5970 2024-04-01T15:24:16.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd277400640 1 -- 172.21.15.142:0/730763805 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd270005490 con 0x7fd2800b5970 2024-04-01T15:24:16.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd277400640 1 -- 172.21.15.142:0/730763805 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270007260 con 0x7fd2800b5970 2024-04-01T15:24:16.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.622+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2801d67f0 con 0x7fd2800b5970 2024-04-01T15:24:16.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.623+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2801e4600 con 0x7fd2800b5970 2024-04-01T15:24:16.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.624+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd280068590 con 0x7fd2800b5970 2024-04-01T15:24:16.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.625+0000 7fd277400640 1 -- 172.21.15.142:0/730763805 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd270007400 con 0x7fd2800b5970 2024-04-01T15:24:16.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.625+0000 7fd277400640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd26006c8f0 0x7fd26006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:16.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.626+0000 7fd277400640 1 -- 172.21.15.142:0/730763805 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd27008b000 con 0x7fd2800b5970 2024-04-01T15:24:16.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.626+0000 7fd27ea00640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd26006c8f0 0x7fd26006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:16.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.627+0000 7fd27ea00640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd26006c8f0 0x7fd26006edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd2800b2a40 tx=0x7fd26c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:16.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.630+0000 7fd277400640 1 -- 172.21.15.142:0/730763805 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd270059440 con 0x7fd2800b5970 2024-04-01T15:24:16.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.826+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2801e5060 con 0x7fd26006c8f0 2024-04-01T15:24:16.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.845+0000 7fd277400640 1 -- 172.21.15.142:0/730763805 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251975 (secure 0 0 0) 0x7fd2801e5060 con 0x7fd26006c8f0 2024-04-01T15:24:16.849 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:24:16.851 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:24:16.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd26006c8f0 msgr2=0x7fd26006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:16.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd26006c8f0 0x7fd26006edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd2800b2a40 tx=0x7fd26c008040 comp rx=0 tx=0).stop 2024-04-01T15:24:16.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2800b5970 msgr2=0x7fd2801d4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:16.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2800b5970 0x7fd2801d4fc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c3f0 tx=0x7fd27000c8b0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 shutdown_connections 2024-04-01T15:24:16.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fd26006c8f0 0x7fd26006edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd28014f820 0x7fd2801e12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2800b5d50 0x7fd2801e4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 --2- 172.21.15.142:0/730763805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2800b5970 0x7fd2801d4fc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:16.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 >> 172.21.15.142:0/730763805 conn(0x7fd28006c710 msgr2=0x7fd2800b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:16.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 shutdown_connections 2024-04-01T15:24:16.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:16.850+0000 7fd285200640 1 -- 172.21.15.142:0/730763805 wait complete. 2024-04-01T15:24:16.870 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-04-01T15:24:16.613306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":625409,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":247,"num_write_kb":2487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5111,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219216,"kb_used_data":3088,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755504,"statfs":{"total":773094113280,"available":772869636096,"internally_reserved":0,"allocated":3162112,"data_stored":1915810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004422"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:11.133460+0000","last_change":"2024-04-01T15:24:11.133511+0000","last_active":"2024-04-01T15:24:11.133460+0000","last_peered":"2024-04-01T15:24:11.133460+0000","last_clean":"2024-04-01T15:24:11.133460+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:24:11.133460+0000","last_undegraded":"2024-04-01T15:24:11.133460+0000","last_fullsized":"2024-04-01T15:24:11.133460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:11.133260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:11.133260+0000","last_clean_scrub_stamp":"2024-04-01T15:24:11.133260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:49:19.051455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.274638+0000","last_change":"2024-04-01T15:23:59.274638+0000","last_active":"2024-04-01T15:23:59.274638+0000","last_peered":"2024-04-01T15:23:59.274638+0000","last_clean":"2024-04-01T15:23:59.274638+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:23:59.274638+0000","last_undegraded":"2024-04-01T15:23:59.274638+0000","last_fullsized":"2024-04-01T15:23:59.274638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.274377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.274377+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.274377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:31.447545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.213665+0000","last_change":"2024-04-01T15:23:54.213665+0000","last_active":"2024-04-01T15:23:54.213665+0000","last_peered":"2024-04-01T15:23:54.213665+0000","last_clean":"2024-04-01T15:23:54.213665+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:23:54.213665+0000","last_undegraded":"2024-04-01T15:23:54.213665+0000","last_fullsized":"2024-04-01T15:23:54.213665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:54.213576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:54.213576+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.213576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:48:18.525274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:06.953599+0000","last_change":"2024-04-01T15:24:06.953714+0000","last_active":"2024-04-01T15:24:06.953599+0000","last_peered":"2024-04-01T15:24:06.953599+0000","last_clean":"2024-04-01T15:24:06.953599+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:24:06.953599+0000","last_undegraded":"2024-04-01T15:24:06.953599+0000","last_fullsized":"2024-04-01T15:24:06.953599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:06.953427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:06.953427+0000","last_clean_scrub_stamp":"2024-04-01T15:24:06.953427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:23:13.710230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:04.141049+0000","last_change":"2024-04-01T15:24:04.141102+0000","last_active":"2024-04-01T15:24:04.141049+0000","last_peered":"2024-04-01T15:24:04.141049+0000","last_clean":"2024-04-01T15:24:04.141049+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:24:04.141049+0000","last_undegraded":"2024-04-01T15:24:04.141049+0000","last_fullsized":"2024-04-01T15:24:04.141049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:04.140837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:04.140837+0000","last_clean_scrub_stamp":"2024-04-01T15:24:04.140837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:12.980805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.440645+0000","last_change":"2024-04-01T15:23:58.440699+0000","last_active":"2024-04-01T15:23:58.440645+0000","last_peered":"2024-04-01T15:23:58.440645+0000","last_clean":"2024-04-01T15:23:58.440645+0000","last_became_active":"2024-04-01T15:22:39.752359+0000","last_became_peered":"2024-04-01T15:22:39.752359+0000","last_unstale":"2024-04-01T15:23:58.440645+0000","last_undegraded":"2024-04-01T15:23:58.440645+0000","last_fullsized":"2024-04-01T15:23:58.440645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.440406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.440406+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.440406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:46:52.634537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.167103+0000","last_change":"2024-04-01T15:23:56.167161+0000","last_active":"2024-04-01T15:23:56.167103+0000","last_peered":"2024-04-01T15:23:56.167103+0000","last_clean":"2024-04-01T15:23:56.167103+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:23:56.167103+0000","last_undegraded":"2024-04-01T15:23:56.167103+0000","last_fullsized":"2024-04-01T15:23:56.167103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.166899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.166899+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.166899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:51.177861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.218421+0000","last_change":"2024-04-01T15:24:01.218472+0000","last_active":"2024-04-01T15:24:01.218421+0000","last_peered":"2024-04-01T15:24:01.218421+0000","last_clean":"2024-04-01T15:24:01.218421+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:24:01.218421+0000","last_undegraded":"2024-04-01T15:24:01.218421+0000","last_fullsized":"2024-04-01T15:24:01.218421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:01.218231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:01.218231+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.218231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:52:16.618365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:05.098281+0000","last_change":"2024-04-01T15:24:05.098332+0000","last_active":"2024-04-01T15:24:05.098281+0000","last_peered":"2024-04-01T15:24:05.098281+0000","last_clean":"2024-04-01T15:24:05.098281+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:24:05.098281+0000","last_undegraded":"2024-04-01T15:24:05.098281+0000","last_fullsized":"2024-04-01T15:24:05.098281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:05.098095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:05.098095+0000","last_clean_scrub_stamp":"2024-04-01T15:24:05.098095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:04.857239+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:05.260843+0000","last_change":"2024-04-01T15:24:05.261024+0000","last_active":"2024-04-01T15:24:05.260843+0000","last_peered":"2024-04-01T15:24:05.260843+0000","last_clean":"2024-04-01T15:24:05.260843+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:24:05.260843+0000","last_undegraded":"2024-04-01T15:24:05.260843+0000","last_fullsized":"2024-04-01T15:24:05.260843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:05.260587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:05.260587+0000","last_clean_scrub_stamp":"2024-04-01T15:24:05.260587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:50:34.312839+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:04.302863+0000","last_change":"2024-04-01T15:24:04.302922+0000","last_active":"2024-04-01T15:24:04.302863+0000","last_peered":"2024-04-01T15:24:04.302863+0000","last_clean":"2024-04-01T15:24:04.302863+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:24:04.302863+0000","last_undegraded":"2024-04-01T15:24:04.302863+0000","last_fullsized":"2024-04-01T15:24:04.302863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:04.302694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:04.302694+0000","last_clean_scrub_stamp":"2024-04-01T15:24:04.302694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:07:21.754542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.488642+0000","last_change":"2024-04-01T15:23:58.488732+0000","last_active":"2024-04-01T15:23:58.488642+0000","last_peered":"2024-04-01T15:23:58.488642+0000","last_clean":"2024-04-01T15:23:58.488642+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:23:58.488642+0000","last_undegraded":"2024-04-01T15:23:58.488642+0000","last_fullsized":"2024-04-01T15:23:58.488642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.488484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.488484+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.488484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:44:40.847626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.208944+0000","last_change":"2024-04-01T15:23:58.209035+0000","last_active":"2024-04-01T15:23:58.208944+0000","last_peered":"2024-04-01T15:23:58.208944+0000","last_clean":"2024-04-01T15:23:58.208944+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:23:58.208944+0000","last_undegraded":"2024-04-01T15:23:58.208944+0000","last_fullsized":"2024-04-01T15:23:58.208944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.208735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.208735+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.208735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:30.381903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'1","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.207318+0000","last_change":"2024-04-01T15:23:58.207413+0000","last_active":"2024-04-01T15:23:58.207318+0000","last_peered":"2024-04-01T15:23:58.207318+0000","last_clean":"2024-04-01T15:23:58.207318+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:23:58.207318+0000","last_undegraded":"2024-04-01T15:23:58.207318+0000","last_fullsized":"2024-04-01T15:23:58.207318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-01T15:23:58.207122+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-01T15:23:58.207122+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.207122+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:30.380290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.209674+0000","last_change":"2024-04-01T15:24:02.209847+0000","last_active":"2024-04-01T15:24:02.209674+0000","last_peered":"2024-04-01T15:24:02.209674+0000","last_clean":"2024-04-01T15:24:02.209674+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:24:02.209674+0000","last_undegraded":"2024-04-01T15:24:02.209674+0000","last_fullsized":"2024-04-01T15:24:02.209674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:02.209439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:02.209439+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.209439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:37:58.591763+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'3","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.968790+0000","last_change":"2024-04-01T15:23:59.968852+0000","last_active":"2024-04-01T15:23:59.968790+0000","last_peered":"2024-04-01T15:23:59.968790+0000","last_clean":"2024-04-01T15:23:59.968790+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:23:59.968790+0000","last_undegraded":"2024-04-01T15:23:59.968790+0000","last_fullsized":"2024-04-01T15:23:59.968790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:23:59.968560+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:23:59.968560+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.968560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:50:29.020811+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:05.966776+0000","last_change":"2024-04-01T15:24:05.966832+0000","last_active":"2024-04-01T15:24:05.966776+0000","last_peered":"2024-04-01T15:24:05.966776+0000","last_clean":"2024-04-01T15:24:05.966776+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:24:05.966776+0000","last_undegraded":"2024-04-01T15:24:05.966776+0000","last_fullsized":"2024-04-01T15:24:05.966776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:05.966551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:05.966551+0000","last_clean_scrub_stamp":"2024-04-01T15:24:05.966551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:51:21.319346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.420503+0000","last_change":"2024-04-01T15:23:55.420529+0000","last_active":"2024-04-01T15:23:55.420503+0000","last_peered":"2024-04-01T15:23:55.420503+0000","last_clean":"2024-04-01T15:23:55.420503+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:23:55.420503+0000","last_undegraded":"2024-04-01T15:23:55.420503+0000","last_fullsized":"2024-04-01T15:23:55.420503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.420397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.420397+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.420397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:27:53.817898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:09.111037+0000","last_change":"2024-04-01T15:24:09.111089+0000","last_active":"2024-04-01T15:24:09.111037+0000","last_peered":"2024-04-01T15:24:09.111037+0000","last_clean":"2024-04-01T15:24:09.111037+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:24:09.111037+0000","last_undegraded":"2024-04-01T15:24:09.111037+0000","last_fullsized":"2024-04-01T15:24:09.111037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:09.110839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:09.110839+0000","last_clean_scrub_stamp":"2024-04-01T15:24:09.110839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:23:15.867643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:06.241035+0000","last_change":"2024-04-01T15:24:06.241135+0000","last_active":"2024-04-01T15:24:06.241035+0000","last_peered":"2024-04-01T15:24:06.241035+0000","last_clean":"2024-04-01T15:24:06.241035+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:24:06.241035+0000","last_undegraded":"2024-04-01T15:24:06.241035+0000","last_fullsized":"2024-04-01T15:24:06.241035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:06.240818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:06.240818+0000","last_clean_scrub_stamp":"2024-04-01T15:24:06.240818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.766806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.224511+0000","last_change":"2024-04-01T15:23:56.224566+0000","last_active":"2024-04-01T15:23:56.224511+0000","last_peered":"2024-04-01T15:23:56.224511+0000","last_clean":"2024-04-01T15:23:56.224511+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:23:56.224511+0000","last_undegraded":"2024-04-01T15:23:56.224511+0000","last_fullsized":"2024-04-01T15:23:56.224511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.224266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.224266+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.224266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:20:29.897973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.911618+0000","last_change":"2024-04-01T15:24:03.911704+0000","last_active":"2024-04-01T15:24:03.911618+0000","last_peered":"2024-04-01T15:24:03.911618+0000","last_clean":"2024-04-01T15:24:03.911618+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:24:03.911618+0000","last_undegraded":"2024-04-01T15:24:03.911618+0000","last_fullsized":"2024-04-01T15:24:03.911618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:03.911414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:03.911414+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.911414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:41:48.631890+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.209404+0000","last_change":"2024-04-01T15:23:56.209508+0000","last_active":"2024-04-01T15:23:56.209404+0000","last_peered":"2024-04-01T15:23:56.209404+0000","last_clean":"2024-04-01T15:23:56.209404+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:23:56.209404+0000","last_undegraded":"2024-04-01T15:23:56.209404+0000","last_fullsized":"2024-04-01T15:23:56.209404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.209177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.209177+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.209177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:19:56.729632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.931556+0000","last_change":"2024-04-01T15:24:00.931556+0000","last_active":"2024-04-01T15:24:00.931556+0000","last_peered":"2024-04-01T15:24:00.931556+0000","last_clean":"2024-04-01T15:24:00.931556+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:24:00.931556+0000","last_undegraded":"2024-04-01T15:24:00.931556+0000","last_fullsized":"2024-04-01T15:24:00.931556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.931209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.931209+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.931209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:31:56.457197+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.250049+0000","last_change":"2024-04-01T15:24:03.250049+0000","last_active":"2024-04-01T15:24:03.250049+0000","last_peered":"2024-04-01T15:24:03.250049+0000","last_clean":"2024-04-01T15:24:03.250049+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:24:03.250049+0000","last_undegraded":"2024-04-01T15:24:03.250049+0000","last_fullsized":"2024-04-01T15:24:03.250049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:03.249733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:03.249733+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.249733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:20.817177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.386033+0000","last_change":"2024-04-01T15:24:02.386033+0000","last_active":"2024-04-01T15:24:02.386033+0000","last_peered":"2024-04-01T15:24:02.386033+0000","last_clean":"2024-04-01T15:24:02.386033+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:24:02.386033+0000","last_undegraded":"2024-04-01T15:24:02.386033+0000","last_fullsized":"2024-04-01T15:24:02.386033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:02.385793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:02.385793+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.385793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:34.558961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.225590+0000","last_change":"2024-04-01T15:24:01.225590+0000","last_active":"2024-04-01T15:24:01.225590+0000","last_peered":"2024-04-01T15:24:01.225590+0000","last_clean":"2024-04-01T15:24:01.225590+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:24:01.225590+0000","last_undegraded":"2024-04-01T15:24:01.225590+0000","last_fullsized":"2024-04-01T15:24:01.225590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:01.225333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:01.225333+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.225333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:17:29.039407+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.252704+0000","last_change":"2024-04-01T15:24:02.252704+0000","last_active":"2024-04-01T15:24:02.252704+0000","last_peered":"2024-04-01T15:24:02.252704+0000","last_clean":"2024-04-01T15:24:02.252704+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:24:02.252704+0000","last_undegraded":"2024-04-01T15:24:02.252704+0000","last_fullsized":"2024-04-01T15:24:02.252704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:02.252462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:02.252462+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.252462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:56:16.050078+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.169242+0000","last_change":"2024-04-01T15:23:59.169242+0000","last_active":"2024-04-01T15:23:59.169242+0000","last_peered":"2024-04-01T15:23:59.169242+0000","last_clean":"2024-04-01T15:23:59.169242+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:23:59.169242+0000","last_undegraded":"2024-04-01T15:23:59.169242+0000","last_fullsized":"2024-04-01T15:23:59.169242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.168944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.168944+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.168944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:43:18.111124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:04.960028+0000","last_change":"2024-04-01T15:24:04.960028+0000","last_active":"2024-04-01T15:24:04.960028+0000","last_peered":"2024-04-01T15:24:04.960028+0000","last_clean":"2024-04-01T15:24:04.960028+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:24:04.960028+0000","last_undegraded":"2024-04-01T15:24:04.960028+0000","last_fullsized":"2024-04-01T15:24:04.960028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:04.959781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:04.959781+0000","last_clean_scrub_stamp":"2024-04-01T15:24:04.959781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:24:14.730478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.399880+0000","last_change":"2024-04-01T15:23:56.399880+0000","last_active":"2024-04-01T15:23:56.399880+0000","last_peered":"2024-04-01T15:23:56.399880+0000","last_clean":"2024-04-01T15:23:56.399880+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:23:56.399880+0000","last_undegraded":"2024-04-01T15:23:56.399880+0000","last_fullsized":"2024-04-01T15:23:56.399880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.399703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.399703+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.399703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:44:42.361232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.414410+0000","last_change":"2024-04-01T15:24:01.414410+0000","last_active":"2024-04-01T15:24:01.414410+0000","last_peered":"2024-04-01T15:24:01.414410+0000","last_clean":"2024-04-01T15:24:01.414410+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:24:01.414410+0000","last_undegraded":"2024-04-01T15:24:01.414410+0000","last_fullsized":"2024-04-01T15:24:01.414410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:01.414160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:01.414160+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.414160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:27.683075+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.486487+0000","last_change":"2024-04-01T15:23:56.486538+0000","last_active":"2024-04-01T15:23:56.486487+0000","last_peered":"2024-04-01T15:23:56.486487+0000","last_clean":"2024-04-01T15:23:56.486487+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:23:56.486487+0000","last_undegraded":"2024-04-01T15:23:56.486487+0000","last_fullsized":"2024-04-01T15:23:56.486487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.486295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.486295+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.486295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:55.629939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.201386+0000","last_change":"2024-04-01T15:23:54.201565+0000","last_active":"2024-04-01T15:23:54.201386+0000","last_peered":"2024-04-01T15:23:54.201386+0000","last_clean":"2024-04-01T15:23:54.201386+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:23:54.201386+0000","last_undegraded":"2024-04-01T15:23:54.201386+0000","last_fullsized":"2024-04-01T15:23:54.201386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-01T15:23:54.200956+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-01T15:23:54.200956+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.200956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:10:55.026222+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.141807+0000","last_change":"2024-04-01T15:24:00.141863+0000","last_active":"2024-04-01T15:24:00.141807+0000","last_peered":"2024-04-01T15:24:00.141807+0000","last_clean":"2024-04-01T15:24:00.141807+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:24:00.141807+0000","last_undegraded":"2024-04-01T15:24:00.141807+0000","last_fullsized":"2024-04-01T15:24:00.141807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.141621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.141621+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.141621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:17:27.955696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.396236+0000","last_change":"2024-04-01T15:23:56.396341+0000","last_active":"2024-04-01T15:23:56.396236+0000","last_peered":"2024-04-01T15:23:56.396236+0000","last_clean":"2024-04-01T15:23:56.396236+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:23:56.396236+0000","last_undegraded":"2024-04-01T15:23:56.396236+0000","last_fullsized":"2024-04-01T15:23:56.396236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-01T15:23:56.395920+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-01T15:23:56.395920+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.395920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:05.323253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:52.225502+0000","last_change":"2024-04-01T15:23:52.225556+0000","last_active":"2024-04-01T15:23:52.225502+0000","last_peered":"2024-04-01T15:23:52.225502+0000","last_clean":"2024-04-01T15:23:52.225502+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:23:52.225502+0000","last_undegraded":"2024-04-01T15:23:52.225502+0000","last_fullsized":"2024-04-01T15:23:52.225502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:52.225315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:52.225315+0000","last_clean_scrub_stamp":"2024-04-01T15:23:52.225315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:01.152648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.183622+0000","last_change":"2024-04-01T15:23:57.183673+0000","last_active":"2024-04-01T15:23:57.183622+0000","last_peered":"2024-04-01T15:23:57.183622+0000","last_clean":"2024-04-01T15:23:57.183622+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:23:57.183622+0000","last_undegraded":"2024-04-01T15:23:57.183622+0000","last_fullsized":"2024-04-01T15:23:57.183622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.183425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.183425+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.183425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:23.452340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.926328+0000","last_change":"2024-04-01T15:23:58.926379+0000","last_active":"2024-04-01T15:23:58.926328+0000","last_peered":"2024-04-01T15:23:58.926328+0000","last_clean":"2024-04-01T15:23:58.926328+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:23:58.926328+0000","last_undegraded":"2024-04-01T15:23:58.926328+0000","last_fullsized":"2024-04-01T15:23:58.926328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.926120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.926120+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.926120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:17:26.740194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.244935+0000","last_change":"2024-04-01T15:24:00.244990+0000","last_active":"2024-04-01T15:24:00.244935+0000","last_peered":"2024-04-01T15:24:00.244935+0000","last_clean":"2024-04-01T15:24:00.244935+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:24:00.244935+0000","last_undegraded":"2024-04-01T15:24:00.244935+0000","last_fullsized":"2024-04-01T15:24:00.244935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.244741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.244741+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.244741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:43:19.186921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.484295+0000","last_change":"2024-04-01T15:23:59.484356+0000","last_active":"2024-04-01T15:23:59.484295+0000","last_peered":"2024-04-01T15:23:59.484295+0000","last_clean":"2024-04-01T15:23:59.484295+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:23:59.484295+0000","last_undegraded":"2024-04-01T15:23:59.484295+0000","last_fullsized":"2024-04-01T15:23:59.484295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-01T15:23:59.484095+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-01T15:23:59.484095+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.484095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:54.495058+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.883122+0000","last_change":"2024-04-01T15:24:02.883177+0000","last_active":"2024-04-01T15:24:02.883122+0000","last_peered":"2024-04-01T15:24:02.883122+0000","last_clean":"2024-04-01T15:24:02.883122+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:24:02.883122+0000","last_undegraded":"2024-04-01T15:24:02.883122+0000","last_fullsized":"2024-04-01T15:24:02.883122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:02.882918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:02.882918+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.882918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:02.642062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.863150+0000","last_change":"2024-04-01T15:23:55.863200+0000","last_active":"2024-04-01T15:23:55.863150+0000","last_peered":"2024-04-01T15:23:55.863150+0000","last_clean":"2024-04-01T15:23:55.863150+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:23:55.863150+0000","last_undegraded":"2024-04-01T15:23:55.863150+0000","last_fullsized":"2024-04-01T15:23:55.863150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.862964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.862964+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.862964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:19:56.383419+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.239547+0000","last_change":"2024-04-01T15:23:57.239684+0000","last_active":"2024-04-01T15:23:57.239547+0000","last_peered":"2024-04-01T15:23:57.239547+0000","last_clean":"2024-04-01T15:23:57.239547+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:23:57.239547+0000","last_undegraded":"2024-04-01T15:23:57.239547+0000","last_fullsized":"2024-04-01T15:23:57.239547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.239316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.239316+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.239316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:23.508230+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'6","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.201764+0000","last_change":"2024-04-01T15:23:54.201888+0000","last_active":"2024-04-01T15:23:54.201764+0000","last_peered":"2024-04-01T15:23:54.201764+0000","last_clean":"2024-04-01T15:23:54.201764+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:23:54.201764+0000","last_undegraded":"2024-04-01T15:23:54.201764+0000","last_fullsized":"2024-04-01T15:23:54.201764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-01T15:23:54.201503+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-01T15:23:54.201503+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.201503+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:18:15.412584+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.477185+0000","last_change":"2024-04-01T15:23:59.477284+0000","last_active":"2024-04-01T15:23:59.477185+0000","last_peered":"2024-04-01T15:23:59.477185+0000","last_clean":"2024-04-01T15:23:59.477185+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:23:59.477185+0000","last_undegraded":"2024-04-01T15:23:59.477185+0000","last_fullsized":"2024-04-01T15:23:59.477185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.476912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.476912+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.476912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:19:46.496821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'39","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.368874+0000","last_change":"2024-04-01T15:23:55.368951+0000","last_active":"2024-04-01T15:23:55.368874+0000","last_peered":"2024-04-01T15:23:55.368874+0000","last_clean":"2024-04-01T15:23:55.368874+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:23:55.368874+0000","last_undegraded":"2024-04-01T15:23:55.368874+0000","last_fullsized":"2024-04-01T15:23:55.368874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'39","last_scrub_stamp":"2024-04-01T15:23:55.368655+0000","last_deep_scrub":"22'39","last_deep_scrub_stamp":"2024-04-01T15:23:55.368655+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.368655+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:18:53.377818+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33940,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:22:39.747459+0000","last_change":"2024-04-01T15:21:58.539751+0000","last_active":"2024-04-01T15:22:39.747459+0000","last_peered":"2024-04-01T15:22:39.747459+0000","last_clean":"2024-04-01T15:22:39.747459+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:22:39.747459+0000","last_undegraded":"2024-04-01T15:22:39.747459+0000","last_fullsized":"2024-04-01T15:22:39.747459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:21:57.472507+0000","last_clean_scrub_stamp":"2024-04-01T15:21:57.472507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:50.243580+0000","last_change":"2024-04-01T15:23:50.243626+0000","last_active":"2024-04-01T15:23:50.243580+0000","last_peered":"2024-04-01T15:23:50.243580+0000","last_clean":"2024-04-01T15:23:50.243580+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:23:50.243580+0000","last_undegraded":"2024-04-01T15:23:50.243580+0000","last_fullsized":"2024-04-01T15:23:50.243580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-01T15:23:50.243445+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-01T15:23:50.243445+0000","last_clean_scrub_stamp":"2024-04-01T15:23:50.243445+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:44:32.602587+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'1","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.104210+0000","last_change":"2024-04-01T15:24:01.104274+0000","last_active":"2024-04-01T15:24:01.104210+0000","last_peered":"2024-04-01T15:24:01.104210+0000","last_clean":"2024-04-01T15:24:01.104210+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:24:01.104210+0000","last_undegraded":"2024-04-01T15:24:01.104210+0000","last_fullsized":"2024-04-01T15:24:01.104210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-01T15:24:01.103936+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-01T15:24:01.103936+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.103936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:37:57.486260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.876489+0000","last_change":"2024-04-01T15:23:56.876583+0000","last_active":"2024-04-01T15:23:56.876489+0000","last_peered":"2024-04-01T15:23:56.876489+0000","last_clean":"2024-04-01T15:23:56.876489+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:23:56.876489+0000","last_undegraded":"2024-04-01T15:23:56.876489+0000","last_fullsized":"2024-04-01T15:23:56.876489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.876192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.876192+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.876192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:23.145107+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:06.142813+0000","last_change":"2024-04-01T15:24:06.142937+0000","last_active":"2024-04-01T15:24:06.142813+0000","last_peered":"2024-04-01T15:24:06.142813+0000","last_clean":"2024-04-01T15:24:06.142813+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:24:06.142813+0000","last_undegraded":"2024-04-01T15:24:06.142813+0000","last_fullsized":"2024-04-01T15:24:06.142813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:06.142557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:06.142557+0000","last_clean_scrub_stamp":"2024-04-01T15:24:06.142557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:01:21.719143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.472030+0000","last_change":"2024-04-01T15:23:58.472087+0000","last_active":"2024-04-01T15:23:58.472030+0000","last_peered":"2024-04-01T15:23:58.472030+0000","last_clean":"2024-04-01T15:23:58.472030+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:23:58.472030+0000","last_undegraded":"2024-04-01T15:23:58.472030+0000","last_fullsized":"2024-04-01T15:23:58.472030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.471843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.471843+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.471843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:10:59.297109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.435263+0000","last_change":"2024-04-01T15:24:00.435318+0000","last_active":"2024-04-01T15:24:00.435263+0000","last_peered":"2024-04-01T15:24:00.435263+0000","last_clean":"2024-04-01T15:24:00.435263+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:24:00.435263+0000","last_undegraded":"2024-04-01T15:24:00.435263+0000","last_fullsized":"2024-04-01T15:24:00.435263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.435054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.435054+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.435054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:20:00.955509+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'12","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:53.449116+0000","last_change":"2024-04-01T15:23:53.449175+0000","last_active":"2024-04-01T15:23:53.449116+0000","last_peered":"2024-04-01T15:23:53.449116+0000","last_clean":"2024-04-01T15:23:53.449116+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:23:53.449116+0000","last_undegraded":"2024-04-01T15:23:53.449116+0000","last_fullsized":"2024-04-01T15:23:53.449116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'12","last_scrub_stamp":"2024-04-01T15:23:53.449004+0000","last_deep_scrub":"22'12","last_deep_scrub_stamp":"2024-04-01T15:23:53.449004+0000","last_clean_scrub_stamp":"2024-04-01T15:23:53.449004+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:56:54.687201+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:08.148735+0000","last_change":"2024-04-01T15:24:08.148796+0000","last_active":"2024-04-01T15:24:08.148735+0000","last_peered":"2024-04-01T15:24:08.148735+0000","last_clean":"2024-04-01T15:24:08.148735+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:24:08.148735+0000","last_undegraded":"2024-04-01T15:24:08.148735+0000","last_fullsized":"2024-04-01T15:24:08.148735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:08.148439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:08.148439+0000","last_clean_scrub_stamp":"2024-04-01T15:24:08.148439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:51:23.501234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.581467+0000","last_change":"2024-04-01T15:23:54.581467+0000","last_active":"2024-04-01T15:23:54.581467+0000","last_peered":"2024-04-01T15:23:54.581467+0000","last_clean":"2024-04-01T15:23:54.581467+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:23:54.581467+0000","last_undegraded":"2024-04-01T15:23:54.581467+0000","last_fullsized":"2024-04-01T15:23:54.581467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-01T15:23:54.581193+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-01T15:23:54.581193+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.581193+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:52:39.560176+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:07.142790+0000","last_change":"2024-04-01T15:24:07.142829+0000","last_active":"2024-04-01T15:24:07.142790+0000","last_peered":"2024-04-01T15:24:07.142790+0000","last_clean":"2024-04-01T15:24:07.142790+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:24:07.142790+0000","last_undegraded":"2024-04-01T15:24:07.142790+0000","last_fullsized":"2024-04-01T15:24:07.142790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:07.142611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:07.142611+0000","last_clean_scrub_stamp":"2024-04-01T15:24:07.142611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:27:11.929802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'3","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:52.428272+0000","last_change":"2024-04-01T15:23:52.428272+0000","last_active":"2024-04-01T15:23:52.428272+0000","last_peered":"2024-04-01T15:23:52.428272+0000","last_clean":"2024-04-01T15:23:52.428272+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:23:52.428272+0000","last_undegraded":"2024-04-01T15:23:52.428272+0000","last_fullsized":"2024-04-01T15:23:52.428272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:23:52.427880+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:23:52.427880+0000","last_clean_scrub_stamp":"2024-04-01T15:23:52.427880+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:09:17.620390+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:10.120705+0000","last_change":"2024-04-01T15:24:10.120756+0000","last_active":"2024-04-01T15:24:10.120705+0000","last_peered":"2024-04-01T15:24:10.120705+0000","last_clean":"2024-04-01T15:24:10.120705+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:24:10.120705+0000","last_undegraded":"2024-04-01T15:24:10.120705+0000","last_fullsized":"2024-04-01T15:24:10.120705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:10.120496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:10.120496+0000","last_clean_scrub_stamp":"2024-04-01T15:24:10.120496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:11:39.213855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'2","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:52.194844+0000","last_change":"2024-04-01T15:23:52.194844+0000","last_active":"2024-04-01T15:23:52.194844+0000","last_peered":"2024-04-01T15:23:52.194844+0000","last_clean":"2024-04-01T15:23:52.194844+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:23:52.194844+0000","last_undegraded":"2024-04-01T15:23:52.194844+0000","last_fullsized":"2024-04-01T15:23:52.194844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-01T15:23:52.194541+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-01T15:23:52.194541+0000","last_clean_scrub_stamp":"2024-04-01T15:23:52.194541+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:19:39.214450+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:08.958475+0000","last_change":"2024-04-01T15:24:08.958554+0000","last_active":"2024-04-01T15:24:08.958475+0000","last_peered":"2024-04-01T15:24:08.958475+0000","last_clean":"2024-04-01T15:24:08.958475+0000","last_became_active":"2024-04-01T15:22:39.739729+0000","last_became_peered":"2024-04-01T15:22:39.739729+0000","last_unstale":"2024-04-01T15:24:08.958475+0000","last_undegraded":"2024-04-01T15:24:08.958475+0000","last_fullsized":"2024-04-01T15:24:08.958475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:08.958234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:08.958234+0000","last_clean_scrub_stamp":"2024-04-01T15:24:08.958234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:49:16.876428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.452199+0000","last_change":"2024-04-01T15:23:54.452199+0000","last_active":"2024-04-01T15:23:54.452199+0000","last_peered":"2024-04-01T15:23:54.452199+0000","last_clean":"2024-04-01T15:23:54.452199+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:23:54.452199+0000","last_undegraded":"2024-04-01T15:23:54.452199+0000","last_fullsized":"2024-04-01T15:23:54.452199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:54.452076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:54.452076+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.452076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:53.595720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.170896+0000","last_change":"2024-04-01T15:24:03.170953+0000","last_active":"2024-04-01T15:24:03.170896+0000","last_peered":"2024-04-01T15:24:03.170896+0000","last_clean":"2024-04-01T15:24:03.170896+0000","last_became_active":"2024-04-01T15:22:39.740443+0000","last_became_peered":"2024-04-01T15:22:39.740443+0000","last_unstale":"2024-04-01T15:24:03.170896+0000","last_undegraded":"2024-04-01T15:24:03.170896+0000","last_fullsized":"2024-04-01T15:24:03.170896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:03.170691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:03.170691+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.170691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:52:18.570825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.127824+0000","last_change":"2024-04-01T15:23:57.127899+0000","last_active":"2024-04-01T15:23:57.127824+0000","last_peered":"2024-04-01T15:23:57.127824+0000","last_clean":"2024-04-01T15:23:57.127824+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:23:57.127824+0000","last_undegraded":"2024-04-01T15:23:57.127824+0000","last_fullsized":"2024-04-01T15:23:57.127824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-04-01T15:23:57.127609+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-04-01T15:23:57.127609+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.127609+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:19:57.648064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.904748+0000","last_change":"2024-04-01T15:23:57.904748+0000","last_active":"2024-04-01T15:23:57.904748+0000","last_peered":"2024-04-01T15:23:57.904748+0000","last_clean":"2024-04-01T15:23:57.904748+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:23:57.904748+0000","last_undegraded":"2024-04-01T15:23:57.904748+0000","last_fullsized":"2024-04-01T15:23:57.904748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.904500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.904500+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.904500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:30.077668+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.205303+0000","last_change":"2024-04-01T15:23:59.205303+0000","last_active":"2024-04-01T15:23:59.205303+0000","last_peered":"2024-04-01T15:23:59.205303+0000","last_clean":"2024-04-01T15:23:59.205303+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:23:59.205303+0000","last_undegraded":"2024-04-01T15:23:59.205303+0000","last_fullsized":"2024-04-01T15:23:59.205303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.204984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.204984+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.204984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:43:18.147165+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.133094+0000","last_change":"2024-04-01T15:23:59.133146+0000","last_active":"2024-04-01T15:23:59.133094+0000","last_peered":"2024-04-01T15:23:59.133094+0000","last_clean":"2024-04-01T15:23:59.133094+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:23:59.133094+0000","last_undegraded":"2024-04-01T15:23:59.133094+0000","last_fullsized":"2024-04-01T15:23:59.133094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.132890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.132890+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.132890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.754434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:53.170793+0000","last_change":"2024-04-01T15:23:53.170793+0000","last_active":"2024-04-01T15:23:53.170793+0000","last_peered":"2024-04-01T15:23:53.170793+0000","last_clean":"2024-04-01T15:23:53.170793+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:23:53.170793+0000","last_undegraded":"2024-04-01T15:23:53.170793+0000","last_fullsized":"2024-04-01T15:23:53.170793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:53.170624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:53.170624+0000","last_clean_scrub_stamp":"2024-04-01T15:23:53.170624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:46:47.364755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:51.444029+0000","last_change":"2024-04-01T15:23:51.444029+0000","last_active":"2024-04-01T15:23:51.444029+0000","last_peered":"2024-04-01T15:23:51.444029+0000","last_clean":"2024-04-01T15:23:51.444029+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:23:51.444029+0000","last_undegraded":"2024-04-01T15:23:51.444029+0000","last_fullsized":"2024-04-01T15:23:51.444029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-01T15:23:51.443897+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-01T15:23:51.443897+0000","last_clean_scrub_stamp":"2024-04-01T15:23:51.443897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:52:36.422881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.226545+0000","last_change":"2024-04-01T15:23:58.226545+0000","last_active":"2024-04-01T15:23:58.226545+0000","last_peered":"2024-04-01T15:23:58.226545+0000","last_clean":"2024-04-01T15:23:58.226545+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:23:58.226545+0000","last_undegraded":"2024-04-01T15:23:58.226545+0000","last_fullsized":"2024-04-01T15:23:58.226545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.226295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.226295+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.226295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:24.495210+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.897956+0000","last_change":"2024-04-01T15:23:54.897956+0000","last_active":"2024-04-01T15:23:54.897956+0000","last_peered":"2024-04-01T15:23:54.897956+0000","last_clean":"2024-04-01T15:23:54.897956+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:23:54.897956+0000","last_undegraded":"2024-04-01T15:23:54.897956+0000","last_fullsized":"2024-04-01T15:23:54.897956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:54.897620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:54.897620+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.897620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:49.908583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.495864+0000","last_change":"2024-04-01T15:23:57.495864+0000","last_active":"2024-04-01T15:23:57.495864+0000","last_peered":"2024-04-01T15:23:57.495864+0000","last_clean":"2024-04-01T15:23:57.495864+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:23:57.495864+0000","last_undegraded":"2024-04-01T15:23:57.495864+0000","last_fullsized":"2024-04-01T15:23:57.495864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.495603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.495603+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.495603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:27:55.893105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:51.231722+0000","last_change":"2024-04-01T15:23:51.231722+0000","last_active":"2024-04-01T15:23:51.231722+0000","last_peered":"2024-04-01T15:23:51.231722+0000","last_clean":"2024-04-01T15:23:51.231722+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:23:51.231722+0000","last_undegraded":"2024-04-01T15:23:51.231722+0000","last_fullsized":"2024-04-01T15:23:51.231722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:51.231573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:51.231573+0000","last_clean_scrub_stamp":"2024-04-01T15:23:51.231573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:44:33.590716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:07.984431+0000","last_change":"2024-04-01T15:24:07.984483+0000","last_active":"2024-04-01T15:24:07.984431+0000","last_peered":"2024-04-01T15:24:07.984431+0000","last_clean":"2024-04-01T15:24:07.984431+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:24:07.984431+0000","last_undegraded":"2024-04-01T15:24:07.984431+0000","last_fullsized":"2024-04-01T15:24:07.984431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:07.984236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:07.984236+0000","last_clean_scrub_stamp":"2024-04-01T15:24:07.984236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:11:37.077594+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.132024+0000","last_change":"2024-04-01T15:23:58.132024+0000","last_active":"2024-04-01T15:23:58.132024+0000","last_peered":"2024-04-01T15:23:58.132024+0000","last_clean":"2024-04-01T15:23:58.132024+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:23:58.132024+0000","last_undegraded":"2024-04-01T15:23:58.132024+0000","last_fullsized":"2024-04-01T15:23:58.132024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.131576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.131576+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.131576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:14:32.094793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.261287+0000","last_change":"2024-04-01T15:23:57.261287+0000","last_active":"2024-04-01T15:23:57.261287+0000","last_peered":"2024-04-01T15:23:57.261287+0000","last_clean":"2024-04-01T15:23:57.261287+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:23:57.261287+0000","last_undegraded":"2024-04-01T15:23:57.261287+0000","last_fullsized":"2024-04-01T15:23:57.261287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.261009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.261009+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.261009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:20:30.934716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.218319+0000","last_change":"2024-04-01T15:23:56.218319+0000","last_active":"2024-04-01T15:23:56.218319+0000","last_peered":"2024-04-01T15:23:56.218319+0000","last_clean":"2024-04-01T15:23:56.218319+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:23:56.218319+0000","last_undegraded":"2024-04-01T15:23:56.218319+0000","last_fullsized":"2024-04-01T15:23:56.218319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-01T15:23:56.217942+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-01T15:23:56.217942+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.217942+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:09:01.892555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.194089+0000","last_change":"2024-04-01T15:23:55.194089+0000","last_active":"2024-04-01T15:23:55.194089+0000","last_peered":"2024-04-01T15:23:55.194089+0000","last_clean":"2024-04-01T15:23:55.194089+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:23:55.194089+0000","last_undegraded":"2024-04-01T15:23:55.194089+0000","last_fullsized":"2024-04-01T15:23:55.194089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:23:55.193792+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:23:55.193792+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.193792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.204755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'3","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.439417+0000","last_change":"2024-04-01T15:23:57.439417+0000","last_active":"2024-04-01T15:23:57.439417+0000","last_peered":"2024-04-01T15:23:57.439417+0000","last_clean":"2024-04-01T15:23:57.439417+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:23:57.439417+0000","last_undegraded":"2024-04-01T15:23:57.439417+0000","last_fullsized":"2024-04-01T15:23:57.439417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:23:57.439157+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:23:57.439157+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.439157+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:18:18.650238+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.181208+0000","last_change":"2024-04-01T15:23:55.181208+0000","last_active":"2024-04-01T15:23:55.181208+0000","last_peered":"2024-04-01T15:23:55.181208+0000","last_clean":"2024-04-01T15:23:55.181208+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:23:55.181208+0000","last_undegraded":"2024-04-01T15:23:55.181208+0000","last_fullsized":"2024-04-01T15:23:55.181208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.181014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.181014+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.181014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:09:00.855628+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.112748+0000","last_change":"2024-04-01T15:24:00.112748+0000","last_active":"2024-04-01T15:24:00.112748+0000","last_peered":"2024-04-01T15:24:00.112748+0000","last_clean":"2024-04-01T15:24:00.112748+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:24:00.112748+0000","last_undegraded":"2024-04-01T15:24:00.112748+0000","last_fullsized":"2024-04-01T15:24:00.112748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.112411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.112411+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.112411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:05:41.343595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.530039+0000","last_change":"2024-04-01T15:23:55.530039+0000","last_active":"2024-04-01T15:23:55.530039+0000","last_peered":"2024-04-01T15:23:55.530039+0000","last_clean":"2024-04-01T15:23:55.530039+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:23:55.530039+0000","last_undegraded":"2024-04-01T15:23:55.530039+0000","last_fullsized":"2024-04-01T15:23:55.530039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.529792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.529792+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.529792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:47:54.039460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:53.184910+0000","last_change":"2024-04-01T15:23:53.184910+0000","last_active":"2024-04-01T15:23:53.184910+0000","last_peered":"2024-04-01T15:23:53.184910+0000","last_clean":"2024-04-01T15:23:53.184910+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:23:53.184910+0000","last_undegraded":"2024-04-01T15:23:53.184910+0000","last_fullsized":"2024-04-01T15:23:53.184910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:53.184674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:53.184674+0000","last_clean_scrub_stamp":"2024-04-01T15:23:53.184674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:38.146006+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.181191+0000","last_change":"2024-04-01T15:24:00.181191+0000","last_active":"2024-04-01T15:24:00.181191+0000","last_peered":"2024-04-01T15:24:00.181191+0000","last_clean":"2024-04-01T15:24:00.181191+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:24:00.181191+0000","last_undegraded":"2024-04-01T15:24:00.181191+0000","last_fullsized":"2024-04-01T15:24:00.181191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.180900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.180900+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.180900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:07:17.632748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.229210+0000","last_change":"2024-04-01T15:23:55.229210+0000","last_active":"2024-04-01T15:23:55.229210+0000","last_peered":"2024-04-01T15:23:55.229210+0000","last_clean":"2024-04-01T15:23:55.229210+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:23:55.229210+0000","last_undegraded":"2024-04-01T15:23:55.229210+0000","last_fullsized":"2024-04-01T15:23:55.229210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.229096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.229096+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.229096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:48:19.540795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:04.225308+0000","last_change":"2024-04-01T15:24:04.225361+0000","last_active":"2024-04-01T15:24:04.225308+0000","last_peered":"2024-04-01T15:24:04.225308+0000","last_clean":"2024-04-01T15:24:04.225308+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:24:04.225308+0000","last_undegraded":"2024-04-01T15:24:04.225308+0000","last_fullsized":"2024-04-01T15:24:04.225308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:04.225124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:04.225124+0000","last_clean_scrub_stamp":"2024-04-01T15:24:04.225124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:07:00.084982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.156991+0000","last_change":"2024-04-01T15:24:01.156991+0000","last_active":"2024-04-01T15:24:01.156991+0000","last_peered":"2024-04-01T15:24:01.156991+0000","last_clean":"2024-04-01T15:24:01.156991+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:24:01.156991+0000","last_undegraded":"2024-04-01T15:24:01.156991+0000","last_fullsized":"2024-04-01T15:24:01.156991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-01T15:24:01.156586+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-01T15:24:01.156586+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.156586+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:07:18.608434+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.339522+0000","last_change":"2024-04-01T15:24:03.339522+0000","last_active":"2024-04-01T15:24:03.339522+0000","last_peered":"2024-04-01T15:24:03.339522+0000","last_clean":"2024-04-01T15:24:03.339522+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:24:03.339522+0000","last_undegraded":"2024-04-01T15:24:03.339522+0000","last_fullsized":"2024-04-01T15:24:03.339522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:03.339266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:03.339266+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.339266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:43:22.281446+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.901566+0000","last_change":"2024-04-01T15:24:01.901721+0000","last_active":"2024-04-01T15:24:01.901566+0000","last_peered":"2024-04-01T15:24:01.901566+0000","last_clean":"2024-04-01T15:24:01.901566+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:24:01.901566+0000","last_undegraded":"2024-04-01T15:24:01.901566+0000","last_fullsized":"2024-04-01T15:24:01.901566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:01.901318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:01.901318+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.901318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:56:15.698933+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'3","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.109180+0000","last_change":"2024-04-01T15:24:03.109253+0000","last_active":"2024-04-01T15:24:03.109180+0000","last_peered":"2024-04-01T15:24:03.109180+0000","last_clean":"2024-04-01T15:24:03.109180+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:24:03.109180+0000","last_undegraded":"2024-04-01T15:24:03.109180+0000","last_fullsized":"2024-04-01T15:24:03.109180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:24:03.108974+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:24:03.108974+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.108974+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:31:58.634962+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.431563+0000","last_change":"2024-04-01T15:23:57.431622+0000","last_active":"2024-04-01T15:23:57.431563+0000","last_peered":"2024-04-01T15:23:57.431563+0000","last_clean":"2024-04-01T15:23:57.431563+0000","last_became_active":"2024-04-01T15:22:39.750255+0000","last_became_peered":"2024-04-01T15:22:39.750255+0000","last_unstale":"2024-04-01T15:23:57.431563+0000","last_undegraded":"2024-04-01T15:23:57.431563+0000","last_fullsized":"2024-04-01T15:23:57.431563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.431381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.431381+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.431381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:18:55.440544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.125118+0000","last_change":"2024-04-01T15:24:02.125175+0000","last_active":"2024-04-01T15:24:02.125118+0000","last_peered":"2024-04-01T15:24:02.125118+0000","last_clean":"2024-04-01T15:24:02.125118+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:24:02.125118+0000","last_undegraded":"2024-04-01T15:24:02.125118+0000","last_fullsized":"2024-04-01T15:24:02.125118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-01T15:24:02.124951+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-01T15:24:02.124951+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.124951+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:50:31.177202+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:52.201141+0000","last_change":"2024-04-01T15:23:52.201141+0000","last_active":"2024-04-01T15:23:52.201141+0000","last_peered":"2024-04-01T15:23:52.201141+0000","last_clean":"2024-04-01T15:23:52.201141+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:23:52.201141+0000","last_undegraded":"2024-04-01T15:23:52.201141+0000","last_fullsized":"2024-04-01T15:23:52.201141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:52.200810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:52.200810+0000","last_clean_scrub_stamp":"2024-04-01T15:23:52.200810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:37.162142+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:53.228145+0000","last_change":"2024-04-01T15:23:53.228145+0000","last_active":"2024-04-01T15:23:53.228145+0000","last_peered":"2024-04-01T15:23:53.228145+0000","last_clean":"2024-04-01T15:23:53.228145+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:23:53.228145+0000","last_undegraded":"2024-04-01T15:23:53.228145+0000","last_fullsized":"2024-04-01T15:23:53.228145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-01T15:23:53.227857+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-01T15:23:53.227857+0000","last_clean_scrub_stamp":"2024-04-01T15:23:53.227857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:18:14.438938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:05.227886+0000","last_change":"2024-04-01T15:24:05.227941+0000","last_active":"2024-04-01T15:24:05.227886+0000","last_peered":"2024-04-01T15:24:05.227886+0000","last_clean":"2024-04-01T15:24:05.227886+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:24:05.227886+0000","last_undegraded":"2024-04-01T15:24:05.227886+0000","last_fullsized":"2024-04-01T15:24:05.227886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:05.227619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:05.227619+0000","last_clean_scrub_stamp":"2024-04-01T15:24:05.227619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:41:49.948095+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'6","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:51.218476+0000","last_change":"2024-04-01T15:23:51.218476+0000","last_active":"2024-04-01T15:23:51.218476+0000","last_peered":"2024-04-01T15:23:51.218476+0000","last_clean":"2024-04-01T15:23:51.218476+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:23:51.218476+0000","last_undegraded":"2024-04-01T15:23:51.218476+0000","last_fullsized":"2024-04-01T15:23:51.218476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-01T15:23:51.218306+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-01T15:23:51.218306+0000","last_clean_scrub_stamp":"2024-04-01T15:23:51.218306+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:19:38.238216+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":35041,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":82,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5111,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":70082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":827392,"data_stored":674074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":117064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":83250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":117367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":674130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":34243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":33940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:24:16.875 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-01T15:21:57.472507+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=21, tm_sec=57, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=15, tm_min=23, tm_sec=48, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T15:24:16.876 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-01T15:24:21.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:24:21.568 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:24:36.877 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T15:24:37.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.091+0000 7fa6aac00640 1 Processor -- start 2024-04-01T15:24:37.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.091+0000 7fa6aac00640 1 -- start start 2024-04-01T15:24:37.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.092+0000 7fa6aac00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6a40b2d20 0x7fa6a41491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.092+0000 7fa6aac00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa6a4149720 0x7fa6a414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6aac00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a40b3180 con 0x7fa6a406d8d0 2024-04-01T15:24:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6aac00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a40b0b20 con 0x7fa6a40b2d20 2024-04-01T15:24:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6aac00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a406dcb0 con 0x7fa6a4149720 2024-04-01T15:24:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6a3400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6a40b2d20 0x7fa6a41491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6a3400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6a40b2d20 0x7fa6a41491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59010/0 (socket says 172.21.15.142:59010) 2024-04-01T15:24:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6a3400640 1 -- 172.21.15.142:0/32504885 learned_addr learned my addr 172.21.15.142:0/32504885 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6a8c00640 1 --2- 172.21.15.142:0/32504885 >> v2:172.21.15.179:3300/0 conn(0x7fa6a4149720 0x7fa6a414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6a3400640 1 -- 172.21.15.142:0/32504885 >> v2:172.21.15.179:3300/0 conn(0x7fa6a4149720 msgr2=0x7fa6a414fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6a3400640 1 --2- 172.21.15.142:0/32504885 >> v2:172.21.15.179:3300/0 conn(0x7fa6a4149720 0x7fa6a414fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6a3400640 1 -- 172.21.15.142:0/32504885 >> v1:172.21.15.179:6789/0 conn(0x7fa6a406d8d0 legacy=0x7fa6a40b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6a3400640 1 -- 172.21.15.142:0/32504885 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a4148ad0 con 0x7fa6a40b2d20 2024-04-01T15:24:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.093+0000 7fa6a8c00640 1 --2- 172.21.15.142:0/32504885 >> v2:172.21.15.179:3300/0 conn(0x7fa6a4149720 0x7fa6a414fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:24:37.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.094+0000 7fa6a3400640 1 --2- 172.21.15.142:0/32504885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 0x7fa6a41491e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40b0ca0 tx=0x7fa69402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45c73ffd217fc23 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:37.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6a2a00640 1 -- 172.21.15.142:0/32504885 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69402e070 con 0x7fa6a40b2d20 2024-04-01T15:24:37.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6a2a00640 1 -- 172.21.15.142:0/32504885 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa694037070 con 0x7fa6a40b2d20 2024-04-01T15:24:37.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6a2a00640 1 -- 172.21.15.142:0/32504885 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694031a00 con 0x7fa6a40b2d20 2024-04-01T15:24:37.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6aac00640 1 -- 172.21.15.142:0/32504885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 msgr2=0x7fa6a41491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6aac00640 1 --2- 172.21.15.142:0/32504885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 0x7fa6a41491e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40b0ca0 tx=0x7fa69402b880 comp rx=0 tx=0).stop 2024-04-01T15:24:37.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6aac00640 1 -- 172.21.15.142:0/32504885 shutdown_connections 2024-04-01T15:24:37.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6aac00640 1 --2- 172.21.15.142:0/32504885 >> v2:172.21.15.179:3300/0 conn(0x7fa6a4149720 0x7fa6a414fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6aac00640 1 --2- 172.21.15.142:0/32504885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 0x7fa6a41491e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6aac00640 1 -- 172.21.15.142:0/32504885 >> 172.21.15.142:0/32504885 conn(0x7fa6a40b5890 msgr2=0x7fa6a40b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:37.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6aac00640 1 -- 172.21.15.142:0/32504885 shutdown_connections 2024-04-01T15:24:37.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.095+0000 7fa6aac00640 1 -- 172.21.15.142:0/32504885 wait complete. 2024-04-01T15:24:37.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.097+0000 7fa6aac00640 1 Processor -- start 2024-04-01T15:24:37.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.097+0000 7fa6aac00640 1 -- start start 2024-04-01T15:24:37.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6aac00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a406d8d0 0x7fa6a40706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6aac00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 0x7fa6a4072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6aac00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a4149720 0x7fa6a41dd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6aac00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a40b16c0 con 0x7fa6a40b2d20 2024-04-01T15:24:37.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6aac00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a40b5510 con 0x7fa6a406d8d0 2024-04-01T15:24:37.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6aac00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a40b4e50 con 0x7fa6a4149720 2024-04-01T15:24:37.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6a3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 0x7fa6a4072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6a3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 0x7fa6a4072270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59020/0 (socket says 172.21.15.142:59020) 2024-04-01T15:24:37.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6a3400640 1 -- 172.21.15.142:0/3370917045 learned_addr learned my addr 172.21.15.142:0/3370917045 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:37.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6a3e00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a406d8d0 0x7fa6a40706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6a8c00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a4149720 0x7fa6a41dd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6a3400640 1 -- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a4149720 msgr2=0x7fa6a41dd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6a3400640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a4149720 0x7fa6a41dd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6a3400640 1 -- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a406d8d0 msgr2=0x7fa6a40706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.098+0000 7fa6a3400640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a406d8d0 0x7fa6a40706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.099+0000 7fa6a3400640 1 -- 172.21.15.142:0/3370917045 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a4071800 con 0x7fa6a40b2d20 2024-04-01T15:24:37.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.099+0000 7fa6a3400640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 0x7fa6a4072270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa694000c00 tx=0x7fa6940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:37.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.099+0000 7fa69be00640 1 -- 172.21.15.142:0/3370917045 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694032880 con 0x7fa6a40b2d20 2024-04-01T15:24:37.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.099+0000 7fa69be00640 1 -- 172.21.15.142:0/3370917045 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa694032a20 con 0x7fa6a40b2d20 2024-04-01T15:24:37.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.099+0000 7fa69be00640 1 -- 172.21.15.142:0/3370917045 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694032e10 con 0x7fa6a40b2d20 2024-04-01T15:24:37.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.099+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a4146040 con 0x7fa6a40b2d20 2024-04-01T15:24:37.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.099+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a4071460 con 0x7fa6a40b2d20 2024-04-01T15:24:37.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.100+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a4068710 con 0x7fa6a40b2d20 2024-04-01T15:24:37.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.101+0000 7fa69be00640 1 -- 172.21.15.142:0/3370917045 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa69404c060 con 0x7fa6a40b2d20 2024-04-01T15:24:37.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.102+0000 7fa69be00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa68006c920 0x7fa68006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.102+0000 7fa69be00640 1 -- 172.21.15.142:0/3370917045 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa6940ad440 con 0x7fa6a40b2d20 2024-04-01T15:24:37.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.103+0000 7fa6a3e00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa68006c920 0x7fa68006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.104+0000 7fa6a3e00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa68006c920 0x7fa68006ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa68c006fd0 tx=0x7fa68c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:37.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.107+0000 7fa69be00640 1 -- 172.21.15.142:0/3370917045 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa694040070 con 0x7fa6a40b2d20 2024-04-01T15:24:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.304+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 --> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6a41dd5a0 con 0x7fa68006c920 2024-04-01T15:24:37.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.323+0000 7fa69be00640 1 -- 172.21.15.142:0/3370917045 <== mgr.4105 v2:172.21.15.179:6832/898130770 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251929 (secure 0 0 0) 0x7fa6a41dd5a0 con 0x7fa68006c920 2024-04-01T15:24:37.327 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:24:37.329 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-01T15:24:37.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.328+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa68006c920 msgr2=0x7fa68006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.328+0000 7fa6aac00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa68006c920 0x7fa68006ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa68c006fd0 tx=0x7fa68c008040 comp rx=0 tx=0).stop 2024-04-01T15:24:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 msgr2=0x7fa6a4072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 0x7fa6a4072270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa694000c00 tx=0x7fa6940046c0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 shutdown_connections 2024-04-01T15:24:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fa68006c920 0x7fa68006ede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a4149720 0x7fa6a41dd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a40b2d20 0x7fa6a4072270 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 --2- 172.21.15.142:0/3370917045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a406d8d0 0x7fa6a40706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 >> 172.21.15.142:0/3370917045 conn(0x7fa6a40b5890 msgr2=0x7fa6a413d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 shutdown_connections 2024-04-01T15:24:37.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.329+0000 7fa6aac00640 1 -- 172.21.15.142:0/3370917045 wait complete. 2024-04-01T15:24:37.350 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-04-01T15:24:36.621008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":625409,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":247,"num_write_kb":2487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5111,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219216,"kb_used_data":3088,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755504,"statfs":{"total":773094113280,"available":772869636096,"internally_reserved":0,"allocated":3162112,"data_stored":1915810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004396"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:11.133460+0000","last_change":"2024-04-01T15:24:11.133511+0000","last_active":"2024-04-01T15:24:11.133460+0000","last_peered":"2024-04-01T15:24:11.133460+0000","last_clean":"2024-04-01T15:24:11.133460+0000","last_became_active":"2024-04-01T15:21:58.537351+0000","last_became_peered":"2024-04-01T15:21:58.537351+0000","last_unstale":"2024-04-01T15:24:11.133460+0000","last_undegraded":"2024-04-01T15:24:11.133460+0000","last_fullsized":"2024-04-01T15:24:11.133460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:11.133260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:11.133260+0000","last_clean_scrub_stamp":"2024-04-01T15:24:11.133260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:49:19.051455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.274638+0000","last_change":"2024-04-01T15:23:59.274638+0000","last_active":"2024-04-01T15:23:59.274638+0000","last_peered":"2024-04-01T15:23:59.274638+0000","last_clean":"2024-04-01T15:23:59.274638+0000","last_became_active":"2024-04-01T15:21:58.523964+0000","last_became_peered":"2024-04-01T15:21:58.523964+0000","last_unstale":"2024-04-01T15:23:59.274638+0000","last_undegraded":"2024-04-01T15:23:59.274638+0000","last_fullsized":"2024-04-01T15:23:59.274638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.274377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.274377+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.274377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:31.447545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.213665+0000","last_change":"2024-04-01T15:23:54.213665+0000","last_active":"2024-04-01T15:23:54.213665+0000","last_peered":"2024-04-01T15:23:54.213665+0000","last_clean":"2024-04-01T15:23:54.213665+0000","last_became_active":"2024-04-01T15:21:58.525761+0000","last_became_peered":"2024-04-01T15:21:58.525761+0000","last_unstale":"2024-04-01T15:23:54.213665+0000","last_undegraded":"2024-04-01T15:23:54.213665+0000","last_fullsized":"2024-04-01T15:23:54.213665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:54.213576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:54.213576+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.213576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:48:18.525274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:06.953599+0000","last_change":"2024-04-01T15:24:06.953714+0000","last_active":"2024-04-01T15:24:06.953599+0000","last_peered":"2024-04-01T15:24:06.953599+0000","last_clean":"2024-04-01T15:24:06.953599+0000","last_became_active":"2024-04-01T15:21:58.540210+0000","last_became_peered":"2024-04-01T15:21:58.540210+0000","last_unstale":"2024-04-01T15:24:06.953599+0000","last_undegraded":"2024-04-01T15:24:06.953599+0000","last_fullsized":"2024-04-01T15:24:06.953599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:06.953427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:06.953427+0000","last_clean_scrub_stamp":"2024-04-01T15:24:06.953427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:23:13.710230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:04.141102+0000","last_change":"2024-04-01T15:24:04.141102+0000","last_active":"2024-04-01T15:24:04.141102+0000","last_peered":"2024-04-01T15:24:04.141102+0000","last_clean":"2024-04-01T15:24:04.141102+0000","last_became_active":"2024-04-01T15:21:58.518543+0000","last_became_peered":"2024-04-01T15:21:58.518543+0000","last_unstale":"2024-04-01T15:24:04.141102+0000","last_undegraded":"2024-04-01T15:24:04.141102+0000","last_fullsized":"2024-04-01T15:24:04.141102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:04.140837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:04.140837+0000","last_clean_scrub_stamp":"2024-04-01T15:24:04.140837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:12.980805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.440645+0000","last_change":"2024-04-01T15:23:58.440699+0000","last_active":"2024-04-01T15:23:58.440645+0000","last_peered":"2024-04-01T15:23:58.440645+0000","last_clean":"2024-04-01T15:23:58.440645+0000","last_became_active":"2024-04-01T15:22:39.752359+0000","last_became_peered":"2024-04-01T15:22:39.752359+0000","last_unstale":"2024-04-01T15:23:58.440645+0000","last_undegraded":"2024-04-01T15:23:58.440645+0000","last_fullsized":"2024-04-01T15:23:58.440645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.440406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.440406+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.440406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:46:52.634537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.167161+0000","last_change":"2024-04-01T15:23:56.167161+0000","last_active":"2024-04-01T15:23:56.167161+0000","last_peered":"2024-04-01T15:23:56.167161+0000","last_clean":"2024-04-01T15:23:56.167161+0000","last_became_active":"2024-04-01T15:21:58.521405+0000","last_became_peered":"2024-04-01T15:21:58.521405+0000","last_unstale":"2024-04-01T15:23:56.167161+0000","last_undegraded":"2024-04-01T15:23:56.167161+0000","last_fullsized":"2024-04-01T15:23:56.167161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.166899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.166899+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.166899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:51.177861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.218472+0000","last_change":"2024-04-01T15:24:01.218472+0000","last_active":"2024-04-01T15:24:01.218472+0000","last_peered":"2024-04-01T15:24:01.218472+0000","last_clean":"2024-04-01T15:24:01.218472+0000","last_became_active":"2024-04-01T15:21:58.529499+0000","last_became_peered":"2024-04-01T15:21:58.529499+0000","last_unstale":"2024-04-01T15:24:01.218472+0000","last_undegraded":"2024-04-01T15:24:01.218472+0000","last_fullsized":"2024-04-01T15:24:01.218472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:01.218231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:01.218231+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.218231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:52:16.618365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:05.098332+0000","last_change":"2024-04-01T15:24:05.098332+0000","last_active":"2024-04-01T15:24:05.098332+0000","last_peered":"2024-04-01T15:24:05.098332+0000","last_clean":"2024-04-01T15:24:05.098332+0000","last_became_active":"2024-04-01T15:21:58.526666+0000","last_became_peered":"2024-04-01T15:21:58.526666+0000","last_unstale":"2024-04-01T15:24:05.098332+0000","last_undegraded":"2024-04-01T15:24:05.098332+0000","last_fullsized":"2024-04-01T15:24:05.098332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:05.098095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:05.098095+0000","last_clean_scrub_stamp":"2024-04-01T15:24:05.098095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:04.857239+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:05.261024+0000","last_change":"2024-04-01T15:24:05.261024+0000","last_active":"2024-04-01T15:24:05.261024+0000","last_peered":"2024-04-01T15:24:05.261024+0000","last_clean":"2024-04-01T15:24:05.261024+0000","last_became_active":"2024-04-01T15:21:58.528271+0000","last_became_peered":"2024-04-01T15:21:58.528271+0000","last_unstale":"2024-04-01T15:24:05.261024+0000","last_undegraded":"2024-04-01T15:24:05.261024+0000","last_fullsized":"2024-04-01T15:24:05.261024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:05.260587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:05.260587+0000","last_clean_scrub_stamp":"2024-04-01T15:24:05.260587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:50:34.312839+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:04.302922+0000","last_change":"2024-04-01T15:24:04.302922+0000","last_active":"2024-04-01T15:24:04.302922+0000","last_peered":"2024-04-01T15:24:04.302922+0000","last_clean":"2024-04-01T15:24:04.302922+0000","last_became_active":"2024-04-01T15:21:58.527457+0000","last_became_peered":"2024-04-01T15:21:58.527457+0000","last_unstale":"2024-04-01T15:24:04.302922+0000","last_undegraded":"2024-04-01T15:24:04.302922+0000","last_fullsized":"2024-04-01T15:24:04.302922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:04.302694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:04.302694+0000","last_clean_scrub_stamp":"2024-04-01T15:24:04.302694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:07:21.754542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.488732+0000","last_change":"2024-04-01T15:23:58.488732+0000","last_active":"2024-04-01T15:23:58.488732+0000","last_peered":"2024-04-01T15:23:58.488732+0000","last_clean":"2024-04-01T15:23:58.488732+0000","last_became_active":"2024-04-01T15:21:58.535194+0000","last_became_peered":"2024-04-01T15:21:58.535194+0000","last_unstale":"2024-04-01T15:23:58.488732+0000","last_undegraded":"2024-04-01T15:23:58.488732+0000","last_fullsized":"2024-04-01T15:23:58.488732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.488484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.488484+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.488484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:44:40.847626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.209035+0000","last_change":"2024-04-01T15:23:58.209035+0000","last_active":"2024-04-01T15:23:58.209035+0000","last_peered":"2024-04-01T15:23:58.209035+0000","last_clean":"2024-04-01T15:23:58.209035+0000","last_became_active":"2024-04-01T15:21:58.528585+0000","last_became_peered":"2024-04-01T15:21:58.528585+0000","last_unstale":"2024-04-01T15:23:58.209035+0000","last_undegraded":"2024-04-01T15:23:58.209035+0000","last_fullsized":"2024-04-01T15:23:58.209035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.208735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.208735+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.208735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:30.381903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'1","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.207413+0000","last_change":"2024-04-01T15:23:58.207413+0000","last_active":"2024-04-01T15:23:58.207413+0000","last_peered":"2024-04-01T15:23:58.207413+0000","last_clean":"2024-04-01T15:23:58.207413+0000","last_became_active":"2024-04-01T15:21:58.529579+0000","last_became_peered":"2024-04-01T15:21:58.529579+0000","last_unstale":"2024-04-01T15:23:58.207413+0000","last_undegraded":"2024-04-01T15:23:58.207413+0000","last_fullsized":"2024-04-01T15:23:58.207413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-01T15:23:58.207122+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-01T15:23:58.207122+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.207122+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:30.380290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.209847+0000","last_change":"2024-04-01T15:24:02.209847+0000","last_active":"2024-04-01T15:24:02.209847+0000","last_peered":"2024-04-01T15:24:02.209847+0000","last_clean":"2024-04-01T15:24:02.209847+0000","last_became_active":"2024-04-01T15:21:58.534986+0000","last_became_peered":"2024-04-01T15:21:58.534986+0000","last_unstale":"2024-04-01T15:24:02.209847+0000","last_undegraded":"2024-04-01T15:24:02.209847+0000","last_fullsized":"2024-04-01T15:24:02.209847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:02.209439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:02.209439+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.209439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:37:58.591763+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.968852+0000","last_change":"2024-04-01T15:23:59.968852+0000","last_active":"2024-04-01T15:23:59.968852+0000","last_peered":"2024-04-01T15:23:59.968852+0000","last_clean":"2024-04-01T15:23:59.968852+0000","last_became_active":"2024-04-01T15:21:58.521982+0000","last_became_peered":"2024-04-01T15:21:58.521982+0000","last_unstale":"2024-04-01T15:23:59.968852+0000","last_undegraded":"2024-04-01T15:23:59.968852+0000","last_fullsized":"2024-04-01T15:23:59.968852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:23:59.968560+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:23:59.968560+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.968560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:50:29.020811+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:05.966832+0000","last_change":"2024-04-01T15:24:05.966832+0000","last_active":"2024-04-01T15:24:05.966832+0000","last_peered":"2024-04-01T15:24:05.966832+0000","last_clean":"2024-04-01T15:24:05.966832+0000","last_became_active":"2024-04-01T15:21:58.530914+0000","last_became_peered":"2024-04-01T15:21:58.530914+0000","last_unstale":"2024-04-01T15:24:05.966832+0000","last_undegraded":"2024-04-01T15:24:05.966832+0000","last_fullsized":"2024-04-01T15:24:05.966832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:05.966551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:05.966551+0000","last_clean_scrub_stamp":"2024-04-01T15:24:05.966551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:51:21.319346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.420529+0000","last_change":"2024-04-01T15:23:55.420529+0000","last_active":"2024-04-01T15:23:55.420529+0000","last_peered":"2024-04-01T15:23:55.420529+0000","last_clean":"2024-04-01T15:23:55.420529+0000","last_became_active":"2024-04-01T15:21:58.522487+0000","last_became_peered":"2024-04-01T15:21:58.522487+0000","last_unstale":"2024-04-01T15:23:55.420529+0000","last_undegraded":"2024-04-01T15:23:55.420529+0000","last_fullsized":"2024-04-01T15:23:55.420529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.420397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.420397+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.420397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:27:53.817898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:09.111089+0000","last_change":"2024-04-01T15:24:09.111089+0000","last_active":"2024-04-01T15:24:09.111089+0000","last_peered":"2024-04-01T15:24:09.111089+0000","last_clean":"2024-04-01T15:24:09.111089+0000","last_became_active":"2024-04-01T15:21:58.532281+0000","last_became_peered":"2024-04-01T15:21:58.532281+0000","last_unstale":"2024-04-01T15:24:09.111089+0000","last_undegraded":"2024-04-01T15:24:09.111089+0000","last_fullsized":"2024-04-01T15:24:09.111089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:09.110839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:09.110839+0000","last_clean_scrub_stamp":"2024-04-01T15:24:09.110839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:23:15.867643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:06.241135+0000","last_change":"2024-04-01T15:24:06.241135+0000","last_active":"2024-04-01T15:24:06.241135+0000","last_peered":"2024-04-01T15:24:06.241135+0000","last_clean":"2024-04-01T15:24:06.241135+0000","last_became_active":"2024-04-01T15:21:58.530166+0000","last_became_peered":"2024-04-01T15:21:58.530166+0000","last_unstale":"2024-04-01T15:24:06.241135+0000","last_undegraded":"2024-04-01T15:24:06.241135+0000","last_fullsized":"2024-04-01T15:24:06.241135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:06.240818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:06.240818+0000","last_clean_scrub_stamp":"2024-04-01T15:24:06.240818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.766806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.224566+0000","last_change":"2024-04-01T15:23:56.224566+0000","last_active":"2024-04-01T15:23:56.224566+0000","last_peered":"2024-04-01T15:23:56.224566+0000","last_clean":"2024-04-01T15:23:56.224566+0000","last_became_active":"2024-04-01T15:21:58.528040+0000","last_became_peered":"2024-04-01T15:21:58.528040+0000","last_unstale":"2024-04-01T15:23:56.224566+0000","last_undegraded":"2024-04-01T15:23:56.224566+0000","last_fullsized":"2024-04-01T15:23:56.224566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.224266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.224266+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.224266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:20:29.897973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.911704+0000","last_change":"2024-04-01T15:24:03.911704+0000","last_active":"2024-04-01T15:24:03.911704+0000","last_peered":"2024-04-01T15:24:03.911704+0000","last_clean":"2024-04-01T15:24:03.911704+0000","last_became_active":"2024-04-01T15:21:58.530233+0000","last_became_peered":"2024-04-01T15:21:58.530233+0000","last_unstale":"2024-04-01T15:24:03.911704+0000","last_undegraded":"2024-04-01T15:24:03.911704+0000","last_fullsized":"2024-04-01T15:24:03.911704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:03.911414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:03.911414+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.911414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:41:48.631890+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.209508+0000","last_change":"2024-04-01T15:23:56.209508+0000","last_active":"2024-04-01T15:23:56.209508+0000","last_peered":"2024-04-01T15:23:56.209508+0000","last_clean":"2024-04-01T15:23:56.209508+0000","last_became_active":"2024-04-01T15:21:58.516103+0000","last_became_peered":"2024-04-01T15:21:58.516103+0000","last_unstale":"2024-04-01T15:23:56.209508+0000","last_undegraded":"2024-04-01T15:23:56.209508+0000","last_fullsized":"2024-04-01T15:23:56.209508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.209177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.209177+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.209177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:19:56.729632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.931556+0000","last_change":"2024-04-01T15:24:00.931556+0000","last_active":"2024-04-01T15:24:00.931556+0000","last_peered":"2024-04-01T15:24:00.931556+0000","last_clean":"2024-04-01T15:24:00.931556+0000","last_became_active":"2024-04-01T15:21:58.525577+0000","last_became_peered":"2024-04-01T15:21:58.525577+0000","last_unstale":"2024-04-01T15:24:00.931556+0000","last_undegraded":"2024-04-01T15:24:00.931556+0000","last_fullsized":"2024-04-01T15:24:00.931556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.931209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.931209+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.931209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:31:56.457197+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.250049+0000","last_change":"2024-04-01T15:24:03.250049+0000","last_active":"2024-04-01T15:24:03.250049+0000","last_peered":"2024-04-01T15:24:03.250049+0000","last_clean":"2024-04-01T15:24:03.250049+0000","last_became_active":"2024-04-01T15:21:58.531661+0000","last_became_peered":"2024-04-01T15:21:58.531661+0000","last_unstale":"2024-04-01T15:24:03.250049+0000","last_undegraded":"2024-04-01T15:24:03.250049+0000","last_fullsized":"2024-04-01T15:24:03.250049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:03.249733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:03.249733+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.249733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:20.817177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.386033+0000","last_change":"2024-04-01T15:24:02.386033+0000","last_active":"2024-04-01T15:24:02.386033+0000","last_peered":"2024-04-01T15:24:02.386033+0000","last_clean":"2024-04-01T15:24:02.386033+0000","last_became_active":"2024-04-01T15:21:58.517038+0000","last_became_peered":"2024-04-01T15:21:58.517038+0000","last_unstale":"2024-04-01T15:24:02.386033+0000","last_undegraded":"2024-04-01T15:24:02.386033+0000","last_fullsized":"2024-04-01T15:24:02.386033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:02.385793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:02.385793+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.385793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:34.558961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.225590+0000","last_change":"2024-04-01T15:24:01.225590+0000","last_active":"2024-04-01T15:24:01.225590+0000","last_peered":"2024-04-01T15:24:01.225590+0000","last_clean":"2024-04-01T15:24:01.225590+0000","last_became_active":"2024-04-01T15:21:58.534800+0000","last_became_peered":"2024-04-01T15:21:58.534800+0000","last_unstale":"2024-04-01T15:24:01.225590+0000","last_undegraded":"2024-04-01T15:24:01.225590+0000","last_fullsized":"2024-04-01T15:24:01.225590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:01.225333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:01.225333+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.225333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:17:29.039407+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.252704+0000","last_change":"2024-04-01T15:24:02.252704+0000","last_active":"2024-04-01T15:24:02.252704+0000","last_peered":"2024-04-01T15:24:02.252704+0000","last_clean":"2024-04-01T15:24:02.252704+0000","last_became_active":"2024-04-01T15:21:58.530265+0000","last_became_peered":"2024-04-01T15:21:58.530265+0000","last_unstale":"2024-04-01T15:24:02.252704+0000","last_undegraded":"2024-04-01T15:24:02.252704+0000","last_fullsized":"2024-04-01T15:24:02.252704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:02.252462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:02.252462+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.252462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:56:16.050078+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.169242+0000","last_change":"2024-04-01T15:23:59.169242+0000","last_active":"2024-04-01T15:23:59.169242+0000","last_peered":"2024-04-01T15:23:59.169242+0000","last_clean":"2024-04-01T15:23:59.169242+0000","last_became_active":"2024-04-01T15:21:58.530628+0000","last_became_peered":"2024-04-01T15:21:58.530628+0000","last_unstale":"2024-04-01T15:23:59.169242+0000","last_undegraded":"2024-04-01T15:23:59.169242+0000","last_fullsized":"2024-04-01T15:23:59.169242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.168944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.168944+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.168944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:43:18.111124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:04.960028+0000","last_change":"2024-04-01T15:24:04.960028+0000","last_active":"2024-04-01T15:24:04.960028+0000","last_peered":"2024-04-01T15:24:04.960028+0000","last_clean":"2024-04-01T15:24:04.960028+0000","last_became_active":"2024-04-01T15:21:58.530520+0000","last_became_peered":"2024-04-01T15:21:58.530520+0000","last_unstale":"2024-04-01T15:24:04.960028+0000","last_undegraded":"2024-04-01T15:24:04.960028+0000","last_fullsized":"2024-04-01T15:24:04.960028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:04.959781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:04.959781+0000","last_clean_scrub_stamp":"2024-04-01T15:24:04.959781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:24:14.730478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.399880+0000","last_change":"2024-04-01T15:23:56.399880+0000","last_active":"2024-04-01T15:23:56.399880+0000","last_peered":"2024-04-01T15:23:56.399880+0000","last_clean":"2024-04-01T15:23:56.399880+0000","last_became_active":"2024-04-01T15:21:58.522805+0000","last_became_peered":"2024-04-01T15:21:58.522805+0000","last_unstale":"2024-04-01T15:23:56.399880+0000","last_undegraded":"2024-04-01T15:23:56.399880+0000","last_fullsized":"2024-04-01T15:23:56.399880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.399703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.399703+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.399703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:44:42.361232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.414410+0000","last_change":"2024-04-01T15:24:01.414410+0000","last_active":"2024-04-01T15:24:01.414410+0000","last_peered":"2024-04-01T15:24:01.414410+0000","last_clean":"2024-04-01T15:24:01.414410+0000","last_became_active":"2024-04-01T15:21:58.513867+0000","last_became_peered":"2024-04-01T15:21:58.513867+0000","last_unstale":"2024-04-01T15:24:01.414410+0000","last_undegraded":"2024-04-01T15:24:01.414410+0000","last_fullsized":"2024-04-01T15:24:01.414410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:01.414160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:01.414160+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.414160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:27.683075+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.486538+0000","last_change":"2024-04-01T15:23:56.486538+0000","last_active":"2024-04-01T15:23:56.486538+0000","last_peered":"2024-04-01T15:23:56.486538+0000","last_clean":"2024-04-01T15:23:56.486538+0000","last_became_active":"2024-04-01T15:21:58.528212+0000","last_became_peered":"2024-04-01T15:21:58.528212+0000","last_unstale":"2024-04-01T15:23:56.486538+0000","last_undegraded":"2024-04-01T15:23:56.486538+0000","last_fullsized":"2024-04-01T15:23:56.486538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.486295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.486295+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.486295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:55.629939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.201565+0000","last_change":"2024-04-01T15:23:54.201565+0000","last_active":"2024-04-01T15:23:54.201565+0000","last_peered":"2024-04-01T15:23:54.201565+0000","last_clean":"2024-04-01T15:23:54.201565+0000","last_became_active":"2024-04-01T15:21:57.522792+0000","last_became_peered":"2024-04-01T15:21:57.522792+0000","last_unstale":"2024-04-01T15:23:54.201565+0000","last_undegraded":"2024-04-01T15:23:54.201565+0000","last_fullsized":"2024-04-01T15:23:54.201565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-01T15:23:54.200956+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-01T15:23:54.200956+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.200956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:10:55.026222+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.141863+0000","last_change":"2024-04-01T15:24:00.141863+0000","last_active":"2024-04-01T15:24:00.141863+0000","last_peered":"2024-04-01T15:24:00.141863+0000","last_clean":"2024-04-01T15:24:00.141863+0000","last_became_active":"2024-04-01T15:21:58.531013+0000","last_became_peered":"2024-04-01T15:21:58.531013+0000","last_unstale":"2024-04-01T15:24:00.141863+0000","last_undegraded":"2024-04-01T15:24:00.141863+0000","last_fullsized":"2024-04-01T15:24:00.141863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.141621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.141621+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.141621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:17:27.955696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.396341+0000","last_change":"2024-04-01T15:23:56.396341+0000","last_active":"2024-04-01T15:23:56.396341+0000","last_peered":"2024-04-01T15:23:56.396341+0000","last_clean":"2024-04-01T15:23:56.396341+0000","last_became_active":"2024-04-01T15:21:57.518078+0000","last_became_peered":"2024-04-01T15:21:57.518078+0000","last_unstale":"2024-04-01T15:23:56.396341+0000","last_undegraded":"2024-04-01T15:23:56.396341+0000","last_fullsized":"2024-04-01T15:23:56.396341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-01T15:23:56.395920+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-01T15:23:56.395920+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.395920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:05.323253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:52.225556+0000","last_change":"2024-04-01T15:23:52.225556+0000","last_active":"2024-04-01T15:23:52.225556+0000","last_peered":"2024-04-01T15:23:52.225556+0000","last_clean":"2024-04-01T15:23:52.225556+0000","last_became_active":"2024-04-01T15:21:57.518367+0000","last_became_peered":"2024-04-01T15:21:57.518367+0000","last_unstale":"2024-04-01T15:23:52.225556+0000","last_undegraded":"2024-04-01T15:23:52.225556+0000","last_fullsized":"2024-04-01T15:23:52.225556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:52.225315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:52.225315+0000","last_clean_scrub_stamp":"2024-04-01T15:23:52.225315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:44:01.152648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.183673+0000","last_change":"2024-04-01T15:23:57.183673+0000","last_active":"2024-04-01T15:23:57.183673+0000","last_peered":"2024-04-01T15:23:57.183673+0000","last_clean":"2024-04-01T15:23:57.183673+0000","last_became_active":"2024-04-01T15:21:58.526235+0000","last_became_peered":"2024-04-01T15:21:58.526235+0000","last_unstale":"2024-04-01T15:23:57.183673+0000","last_undegraded":"2024-04-01T15:23:57.183673+0000","last_fullsized":"2024-04-01T15:23:57.183673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.183425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.183425+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.183425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:23.452340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.926379+0000","last_change":"2024-04-01T15:23:58.926379+0000","last_active":"2024-04-01T15:23:58.926379+0000","last_peered":"2024-04-01T15:23:58.926379+0000","last_clean":"2024-04-01T15:23:58.926379+0000","last_became_active":"2024-04-01T15:21:57.534651+0000","last_became_peered":"2024-04-01T15:21:57.534651+0000","last_unstale":"2024-04-01T15:23:58.926379+0000","last_undegraded":"2024-04-01T15:23:58.926379+0000","last_fullsized":"2024-04-01T15:23:58.926379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.926120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.926120+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.926120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:17:26.740194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.244990+0000","last_change":"2024-04-01T15:24:00.244990+0000","last_active":"2024-04-01T15:24:00.244990+0000","last_peered":"2024-04-01T15:24:00.244990+0000","last_clean":"2024-04-01T15:24:00.244990+0000","last_became_active":"2024-04-01T15:21:58.524639+0000","last_became_peered":"2024-04-01T15:21:58.524639+0000","last_unstale":"2024-04-01T15:24:00.244990+0000","last_undegraded":"2024-04-01T15:24:00.244990+0000","last_fullsized":"2024-04-01T15:24:00.244990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.244741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.244741+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.244741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:43:19.186921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.484356+0000","last_change":"2024-04-01T15:23:59.484356+0000","last_active":"2024-04-01T15:23:59.484356+0000","last_peered":"2024-04-01T15:23:59.484356+0000","last_clean":"2024-04-01T15:23:59.484356+0000","last_became_active":"2024-04-01T15:21:57.528518+0000","last_became_peered":"2024-04-01T15:21:57.528518+0000","last_unstale":"2024-04-01T15:23:59.484356+0000","last_undegraded":"2024-04-01T15:23:59.484356+0000","last_fullsized":"2024-04-01T15:23:59.484356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-01T15:23:59.484095+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-01T15:23:59.484095+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.484095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:54.495058+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.883177+0000","last_change":"2024-04-01T15:24:02.883177+0000","last_active":"2024-04-01T15:24:02.883177+0000","last_peered":"2024-04-01T15:24:02.883177+0000","last_clean":"2024-04-01T15:24:02.883177+0000","last_became_active":"2024-04-01T15:21:58.529069+0000","last_became_peered":"2024-04-01T15:21:58.529069+0000","last_unstale":"2024-04-01T15:24:02.883177+0000","last_undegraded":"2024-04-01T15:24:02.883177+0000","last_fullsized":"2024-04-01T15:24:02.883177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:02.882918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:02.882918+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.882918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:02.642062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.863200+0000","last_change":"2024-04-01T15:23:55.863200+0000","last_active":"2024-04-01T15:23:55.863200+0000","last_peered":"2024-04-01T15:23:55.863200+0000","last_clean":"2024-04-01T15:23:55.863200+0000","last_became_active":"2024-04-01T15:21:57.526225+0000","last_became_peered":"2024-04-01T15:21:57.526225+0000","last_unstale":"2024-04-01T15:23:55.863200+0000","last_undegraded":"2024-04-01T15:23:55.863200+0000","last_fullsized":"2024-04-01T15:23:55.863200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.862964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.862964+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.862964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:19:56.383419+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.239684+0000","last_change":"2024-04-01T15:23:57.239684+0000","last_active":"2024-04-01T15:23:57.239684+0000","last_peered":"2024-04-01T15:23:57.239684+0000","last_clean":"2024-04-01T15:23:57.239684+0000","last_became_active":"2024-04-01T15:21:58.522202+0000","last_became_peered":"2024-04-01T15:21:58.522202+0000","last_unstale":"2024-04-01T15:23:57.239684+0000","last_undegraded":"2024-04-01T15:23:57.239684+0000","last_fullsized":"2024-04-01T15:23:57.239684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.239316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.239316+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.239316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:23.508230+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'6","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.201888+0000","last_change":"2024-04-01T15:23:54.201888+0000","last_active":"2024-04-01T15:23:54.201888+0000","last_peered":"2024-04-01T15:23:54.201888+0000","last_clean":"2024-04-01T15:23:54.201888+0000","last_became_active":"2024-04-01T15:21:57.526316+0000","last_became_peered":"2024-04-01T15:21:57.526316+0000","last_unstale":"2024-04-01T15:23:54.201888+0000","last_undegraded":"2024-04-01T15:23:54.201888+0000","last_fullsized":"2024-04-01T15:23:54.201888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-01T15:23:54.201503+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-01T15:23:54.201503+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.201503+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:18:15.412584+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.477284+0000","last_change":"2024-04-01T15:23:59.477284+0000","last_active":"2024-04-01T15:23:59.477284+0000","last_peered":"2024-04-01T15:23:59.477284+0000","last_clean":"2024-04-01T15:23:59.477284+0000","last_became_active":"2024-04-01T15:21:58.537149+0000","last_became_peered":"2024-04-01T15:21:58.537149+0000","last_unstale":"2024-04-01T15:23:59.477284+0000","last_undegraded":"2024-04-01T15:23:59.477284+0000","last_fullsized":"2024-04-01T15:23:59.477284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.476912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.476912+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.476912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:19:46.496821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'39","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.368951+0000","last_change":"2024-04-01T15:23:55.368951+0000","last_active":"2024-04-01T15:23:55.368951+0000","last_peered":"2024-04-01T15:23:55.368951+0000","last_clean":"2024-04-01T15:23:55.368951+0000","last_became_active":"2024-04-01T15:21:57.513430+0000","last_became_peered":"2024-04-01T15:21:57.513430+0000","last_unstale":"2024-04-01T15:23:55.368951+0000","last_undegraded":"2024-04-01T15:23:55.368951+0000","last_fullsized":"2024-04-01T15:23:55.368951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'39","last_scrub_stamp":"2024-04-01T15:23:55.368655+0000","last_deep_scrub":"22'39","last_deep_scrub_stamp":"2024-04-01T15:23:55.368655+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.368655+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:18:53.377818+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33940,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:12.143397+0000","last_change":"2024-04-01T15:24:12.143397+0000","last_active":"2024-04-01T15:24:12.143397+0000","last_peered":"2024-04-01T15:24:12.143397+0000","last_clean":"2024-04-01T15:24:12.143397+0000","last_became_active":"2024-04-01T15:21:58.539440+0000","last_became_peered":"2024-04-01T15:21:58.539440+0000","last_unstale":"2024-04-01T15:24:12.143397+0000","last_undegraded":"2024-04-01T15:24:12.143397+0000","last_fullsized":"2024-04-01T15:24:12.143397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:12.143145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:12.143145+0000","last_clean_scrub_stamp":"2024-04-01T15:24:12.143145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:03:52.234508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:50.243626+0000","last_change":"2024-04-01T15:23:50.243626+0000","last_active":"2024-04-01T15:23:50.243626+0000","last_peered":"2024-04-01T15:23:50.243626+0000","last_clean":"2024-04-01T15:23:50.243626+0000","last_became_active":"2024-04-01T15:21:57.519828+0000","last_became_peered":"2024-04-01T15:21:57.519828+0000","last_unstale":"2024-04-01T15:23:50.243626+0000","last_undegraded":"2024-04-01T15:23:50.243626+0000","last_fullsized":"2024-04-01T15:23:50.243626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-01T15:23:50.243445+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-01T15:23:50.243445+0000","last_clean_scrub_stamp":"2024-04-01T15:23:50.243445+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:44:32.602587+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'1","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.104274+0000","last_change":"2024-04-01T15:24:01.104274+0000","last_active":"2024-04-01T15:24:01.104274+0000","last_peered":"2024-04-01T15:24:01.104274+0000","last_clean":"2024-04-01T15:24:01.104274+0000","last_became_active":"2024-04-01T15:21:58.522704+0000","last_became_peered":"2024-04-01T15:21:58.522704+0000","last_unstale":"2024-04-01T15:24:01.104274+0000","last_undegraded":"2024-04-01T15:24:01.104274+0000","last_fullsized":"2024-04-01T15:24:01.104274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-01T15:24:01.103936+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-01T15:24:01.103936+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.103936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:37:57.486260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.876583+0000","last_change":"2024-04-01T15:23:56.876583+0000","last_active":"2024-04-01T15:23:56.876583+0000","last_peered":"2024-04-01T15:23:56.876583+0000","last_clean":"2024-04-01T15:23:56.876583+0000","last_became_active":"2024-04-01T15:21:57.527470+0000","last_became_peered":"2024-04-01T15:21:57.527470+0000","last_unstale":"2024-04-01T15:23:56.876583+0000","last_undegraded":"2024-04-01T15:23:56.876583+0000","last_fullsized":"2024-04-01T15:23:56.876583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:56.876192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:56.876192+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.876192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:23.145107+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:06.142937+0000","last_change":"2024-04-01T15:24:06.142937+0000","last_active":"2024-04-01T15:24:06.142937+0000","last_peered":"2024-04-01T15:24:06.142937+0000","last_clean":"2024-04-01T15:24:06.142937+0000","last_became_active":"2024-04-01T15:21:58.528161+0000","last_became_peered":"2024-04-01T15:21:58.528161+0000","last_unstale":"2024-04-01T15:24:06.142937+0000","last_undegraded":"2024-04-01T15:24:06.142937+0000","last_fullsized":"2024-04-01T15:24:06.142937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:06.142557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:06.142557+0000","last_clean_scrub_stamp":"2024-04-01T15:24:06.142557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:01:21.719143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.472087+0000","last_change":"2024-04-01T15:23:58.472087+0000","last_active":"2024-04-01T15:23:58.472087+0000","last_peered":"2024-04-01T15:23:58.472087+0000","last_clean":"2024-04-01T15:23:58.472087+0000","last_became_active":"2024-04-01T15:21:57.527681+0000","last_became_peered":"2024-04-01T15:21:57.527681+0000","last_unstale":"2024-04-01T15:23:58.472087+0000","last_undegraded":"2024-04-01T15:23:58.472087+0000","last_fullsized":"2024-04-01T15:23:58.472087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.471843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.471843+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.471843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:10:59.297109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.435318+0000","last_change":"2024-04-01T15:24:00.435318+0000","last_active":"2024-04-01T15:24:00.435318+0000","last_peered":"2024-04-01T15:24:00.435318+0000","last_clean":"2024-04-01T15:24:00.435318+0000","last_became_active":"2024-04-01T15:21:58.513553+0000","last_became_peered":"2024-04-01T15:21:58.513553+0000","last_unstale":"2024-04-01T15:24:00.435318+0000","last_undegraded":"2024-04-01T15:24:00.435318+0000","last_fullsized":"2024-04-01T15:24:00.435318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.435054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.435054+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.435054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:20:00.955509+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'12","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:53.449175+0000","last_change":"2024-04-01T15:23:53.449175+0000","last_active":"2024-04-01T15:23:53.449175+0000","last_peered":"2024-04-01T15:23:53.449175+0000","last_clean":"2024-04-01T15:23:53.449175+0000","last_became_active":"2024-04-01T15:21:57.516861+0000","last_became_peered":"2024-04-01T15:21:57.516861+0000","last_unstale":"2024-04-01T15:23:53.449175+0000","last_undegraded":"2024-04-01T15:23:53.449175+0000","last_fullsized":"2024-04-01T15:23:53.449175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'12","last_scrub_stamp":"2024-04-01T15:23:53.449004+0000","last_deep_scrub":"22'12","last_deep_scrub_stamp":"2024-04-01T15:23:53.449004+0000","last_clean_scrub_stamp":"2024-04-01T15:23:53.449004+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:56:54.687201+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:08.148796+0000","last_change":"2024-04-01T15:24:08.148796+0000","last_active":"2024-04-01T15:24:08.148796+0000","last_peered":"2024-04-01T15:24:08.148796+0000","last_clean":"2024-04-01T15:24:08.148796+0000","last_became_active":"2024-04-01T15:21:58.529555+0000","last_became_peered":"2024-04-01T15:21:58.529555+0000","last_unstale":"2024-04-01T15:24:08.148796+0000","last_undegraded":"2024-04-01T15:24:08.148796+0000","last_fullsized":"2024-04-01T15:24:08.148796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:08.148439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:08.148439+0000","last_clean_scrub_stamp":"2024-04-01T15:24:08.148439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:51:23.501234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.581467+0000","last_change":"2024-04-01T15:23:54.581467+0000","last_active":"2024-04-01T15:23:54.581467+0000","last_peered":"2024-04-01T15:23:54.581467+0000","last_clean":"2024-04-01T15:23:54.581467+0000","last_became_active":"2024-04-01T15:21:57.519307+0000","last_became_peered":"2024-04-01T15:21:57.519307+0000","last_unstale":"2024-04-01T15:23:54.581467+0000","last_undegraded":"2024-04-01T15:23:54.581467+0000","last_fullsized":"2024-04-01T15:23:54.581467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-01T15:23:54.581193+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-01T15:23:54.581193+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.581193+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:52:39.560176+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:07.142829+0000","last_change":"2024-04-01T15:24:07.142829+0000","last_active":"2024-04-01T15:24:07.142829+0000","last_peered":"2024-04-01T15:24:07.142829+0000","last_clean":"2024-04-01T15:24:07.142829+0000","last_became_active":"2024-04-01T15:21:58.528813+0000","last_became_peered":"2024-04-01T15:21:58.528813+0000","last_unstale":"2024-04-01T15:24:07.142829+0000","last_undegraded":"2024-04-01T15:24:07.142829+0000","last_fullsized":"2024-04-01T15:24:07.142829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:07.142611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:07.142611+0000","last_clean_scrub_stamp":"2024-04-01T15:24:07.142611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:27:11.929802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'3","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:52.428272+0000","last_change":"2024-04-01T15:23:52.428272+0000","last_active":"2024-04-01T15:23:52.428272+0000","last_peered":"2024-04-01T15:23:52.428272+0000","last_clean":"2024-04-01T15:23:52.428272+0000","last_became_active":"2024-04-01T15:21:57.513579+0000","last_became_peered":"2024-04-01T15:21:57.513579+0000","last_unstale":"2024-04-01T15:23:52.428272+0000","last_undegraded":"2024-04-01T15:23:52.428272+0000","last_fullsized":"2024-04-01T15:23:52.428272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:23:52.427880+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:23:52.427880+0000","last_clean_scrub_stamp":"2024-04-01T15:23:52.427880+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:09:17.620390+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:10.120756+0000","last_change":"2024-04-01T15:24:10.120756+0000","last_active":"2024-04-01T15:24:10.120756+0000","last_peered":"2024-04-01T15:24:10.120756+0000","last_clean":"2024-04-01T15:24:10.120756+0000","last_became_active":"2024-04-01T15:21:58.535347+0000","last_became_peered":"2024-04-01T15:21:58.535347+0000","last_unstale":"2024-04-01T15:24:10.120756+0000","last_undegraded":"2024-04-01T15:24:10.120756+0000","last_fullsized":"2024-04-01T15:24:10.120756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:10.120496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:10.120496+0000","last_clean_scrub_stamp":"2024-04-01T15:24:10.120496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:11:39.213855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'2","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:52.194844+0000","last_change":"2024-04-01T15:23:52.194844+0000","last_active":"2024-04-01T15:23:52.194844+0000","last_peered":"2024-04-01T15:23:52.194844+0000","last_clean":"2024-04-01T15:23:52.194844+0000","last_became_active":"2024-04-01T15:21:57.522012+0000","last_became_peered":"2024-04-01T15:21:57.522012+0000","last_unstale":"2024-04-01T15:23:52.194844+0000","last_undegraded":"2024-04-01T15:23:52.194844+0000","last_fullsized":"2024-04-01T15:23:52.194844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-01T15:23:52.194541+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-01T15:23:52.194541+0000","last_clean_scrub_stamp":"2024-04-01T15:23:52.194541+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:19:39.214450+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:08.958554+0000","last_change":"2024-04-01T15:24:08.958554+0000","last_active":"2024-04-01T15:24:08.958554+0000","last_peered":"2024-04-01T15:24:08.958554+0000","last_clean":"2024-04-01T15:24:08.958554+0000","last_became_active":"2024-04-01T15:22:39.739729+0000","last_became_peered":"2024-04-01T15:22:39.739729+0000","last_unstale":"2024-04-01T15:24:08.958554+0000","last_undegraded":"2024-04-01T15:24:08.958554+0000","last_fullsized":"2024-04-01T15:24:08.958554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:08.958234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:08.958234+0000","last_clean_scrub_stamp":"2024-04-01T15:24:08.958234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:49:16.876428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.452199+0000","last_change":"2024-04-01T15:23:54.452199+0000","last_active":"2024-04-01T15:23:54.452199+0000","last_peered":"2024-04-01T15:23:54.452199+0000","last_clean":"2024-04-01T15:23:54.452199+0000","last_became_active":"2024-04-01T15:21:57.531817+0000","last_became_peered":"2024-04-01T15:21:57.531817+0000","last_unstale":"2024-04-01T15:23:54.452199+0000","last_undegraded":"2024-04-01T15:23:54.452199+0000","last_fullsized":"2024-04-01T15:23:54.452199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:54.452076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:54.452076+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.452076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:53.595720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.170896+0000","last_change":"2024-04-01T15:24:03.170953+0000","last_active":"2024-04-01T15:24:03.170896+0000","last_peered":"2024-04-01T15:24:03.170896+0000","last_clean":"2024-04-01T15:24:03.170896+0000","last_became_active":"2024-04-01T15:22:39.740443+0000","last_became_peered":"2024-04-01T15:22:39.740443+0000","last_unstale":"2024-04-01T15:24:03.170896+0000","last_undegraded":"2024-04-01T15:24:03.170896+0000","last_fullsized":"2024-04-01T15:24:03.170896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:03.170691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:03.170691+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.170691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:52:18.570825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.127824+0000","last_change":"2024-04-01T15:23:57.127899+0000","last_active":"2024-04-01T15:23:57.127824+0000","last_peered":"2024-04-01T15:23:57.127824+0000","last_clean":"2024-04-01T15:23:57.127824+0000","last_became_active":"2024-04-01T15:21:47.877548+0000","last_became_peered":"2024-04-01T15:21:47.877548+0000","last_unstale":"2024-04-01T15:23:57.127824+0000","last_undegraded":"2024-04-01T15:23:57.127824+0000","last_fullsized":"2024-04-01T15:23:57.127824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-04-01T15:23:57.127609+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-04-01T15:23:57.127609+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.127609+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:19:57.648064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.904748+0000","last_change":"2024-04-01T15:23:57.904748+0000","last_active":"2024-04-01T15:23:57.904748+0000","last_peered":"2024-04-01T15:23:57.904748+0000","last_clean":"2024-04-01T15:23:57.904748+0000","last_became_active":"2024-04-01T15:21:57.522210+0000","last_became_peered":"2024-04-01T15:21:57.522210+0000","last_unstale":"2024-04-01T15:23:57.904748+0000","last_undegraded":"2024-04-01T15:23:57.904748+0000","last_fullsized":"2024-04-01T15:23:57.904748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.904500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.904500+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.904500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:30.077668+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.205303+0000","last_change":"2024-04-01T15:23:59.205303+0000","last_active":"2024-04-01T15:23:59.205303+0000","last_peered":"2024-04-01T15:23:59.205303+0000","last_clean":"2024-04-01T15:23:59.205303+0000","last_became_active":"2024-04-01T15:21:58.529486+0000","last_became_peered":"2024-04-01T15:21:58.529486+0000","last_unstale":"2024-04-01T15:23:59.205303+0000","last_undegraded":"2024-04-01T15:23:59.205303+0000","last_fullsized":"2024-04-01T15:23:59.205303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.204984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.204984+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.204984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:43:18.147165+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:59.133094+0000","last_change":"2024-04-01T15:23:59.133146+0000","last_active":"2024-04-01T15:23:59.133094+0000","last_peered":"2024-04-01T15:23:59.133094+0000","last_clean":"2024-04-01T15:23:59.133094+0000","last_became_active":"2024-04-01T15:21:57.526543+0000","last_became_peered":"2024-04-01T15:21:57.526543+0000","last_unstale":"2024-04-01T15:23:59.133094+0000","last_undegraded":"2024-04-01T15:23:59.133094+0000","last_fullsized":"2024-04-01T15:23:59.133094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:59.132890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:59.132890+0000","last_clean_scrub_stamp":"2024-04-01T15:23:59.132890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.754434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:53.170793+0000","last_change":"2024-04-01T15:23:53.170793+0000","last_active":"2024-04-01T15:23:53.170793+0000","last_peered":"2024-04-01T15:23:53.170793+0000","last_clean":"2024-04-01T15:23:53.170793+0000","last_became_active":"2024-04-01T15:21:58.520935+0000","last_became_peered":"2024-04-01T15:21:58.520935+0000","last_unstale":"2024-04-01T15:23:53.170793+0000","last_undegraded":"2024-04-01T15:23:53.170793+0000","last_fullsized":"2024-04-01T15:23:53.170793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:53.170624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:53.170624+0000","last_clean_scrub_stamp":"2024-04-01T15:23:53.170624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:46:47.364755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:51.444029+0000","last_change":"2024-04-01T15:23:51.444029+0000","last_active":"2024-04-01T15:23:51.444029+0000","last_peered":"2024-04-01T15:23:51.444029+0000","last_clean":"2024-04-01T15:23:51.444029+0000","last_became_active":"2024-04-01T15:21:57.510800+0000","last_became_peered":"2024-04-01T15:21:57.510800+0000","last_unstale":"2024-04-01T15:23:51.444029+0000","last_undegraded":"2024-04-01T15:23:51.444029+0000","last_fullsized":"2024-04-01T15:23:51.444029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-01T15:23:51.443897+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-01T15:23:51.443897+0000","last_clean_scrub_stamp":"2024-04-01T15:23:51.443897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:52:36.422881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.226545+0000","last_change":"2024-04-01T15:23:58.226545+0000","last_active":"2024-04-01T15:23:58.226545+0000","last_peered":"2024-04-01T15:23:58.226545+0000","last_clean":"2024-04-01T15:23:58.226545+0000","last_became_active":"2024-04-01T15:21:58.523482+0000","last_became_peered":"2024-04-01T15:21:58.523482+0000","last_unstale":"2024-04-01T15:23:58.226545+0000","last_undegraded":"2024-04-01T15:23:58.226545+0000","last_fullsized":"2024-04-01T15:23:58.226545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.226295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.226295+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.226295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:24:24.495210+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:54.897956+0000","last_change":"2024-04-01T15:23:54.897956+0000","last_active":"2024-04-01T15:23:54.897956+0000","last_peered":"2024-04-01T15:23:54.897956+0000","last_clean":"2024-04-01T15:23:54.897956+0000","last_became_active":"2024-04-01T15:21:57.526476+0000","last_became_peered":"2024-04-01T15:21:57.526476+0000","last_unstale":"2024-04-01T15:23:54.897956+0000","last_undegraded":"2024-04-01T15:23:54.897956+0000","last_fullsized":"2024-04-01T15:23:54.897956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:54.897620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:54.897620+0000","last_clean_scrub_stamp":"2024-04-01T15:23:54.897620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:49.908583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.495864+0000","last_change":"2024-04-01T15:23:57.495864+0000","last_active":"2024-04-01T15:23:57.495864+0000","last_peered":"2024-04-01T15:23:57.495864+0000","last_clean":"2024-04-01T15:23:57.495864+0000","last_became_active":"2024-04-01T15:21:58.530753+0000","last_became_peered":"2024-04-01T15:21:58.530753+0000","last_unstale":"2024-04-01T15:23:57.495864+0000","last_undegraded":"2024-04-01T15:23:57.495864+0000","last_fullsized":"2024-04-01T15:23:57.495864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.495603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.495603+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.495603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:27:55.893105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:51.231722+0000","last_change":"2024-04-01T15:23:51.231722+0000","last_active":"2024-04-01T15:23:51.231722+0000","last_peered":"2024-04-01T15:23:51.231722+0000","last_clean":"2024-04-01T15:23:51.231722+0000","last_became_active":"2024-04-01T15:21:57.516180+0000","last_became_peered":"2024-04-01T15:21:57.516180+0000","last_unstale":"2024-04-01T15:23:51.231722+0000","last_undegraded":"2024-04-01T15:23:51.231722+0000","last_fullsized":"2024-04-01T15:23:51.231722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:51.231573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:51.231573+0000","last_clean_scrub_stamp":"2024-04-01T15:23:51.231573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:44:33.590716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:07.984431+0000","last_change":"2024-04-01T15:24:07.984483+0000","last_active":"2024-04-01T15:24:07.984431+0000","last_peered":"2024-04-01T15:24:07.984431+0000","last_clean":"2024-04-01T15:24:07.984431+0000","last_became_active":"2024-04-01T15:21:58.541073+0000","last_became_peered":"2024-04-01T15:21:58.541073+0000","last_unstale":"2024-04-01T15:24:07.984431+0000","last_undegraded":"2024-04-01T15:24:07.984431+0000","last_fullsized":"2024-04-01T15:24:07.984431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:07.984236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:07.984236+0000","last_clean_scrub_stamp":"2024-04-01T15:24:07.984236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:11:37.077594+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:58.132024+0000","last_change":"2024-04-01T15:23:58.132024+0000","last_active":"2024-04-01T15:23:58.132024+0000","last_peered":"2024-04-01T15:23:58.132024+0000","last_clean":"2024-04-01T15:23:58.132024+0000","last_became_active":"2024-04-01T15:21:57.526586+0000","last_became_peered":"2024-04-01T15:21:57.526586+0000","last_unstale":"2024-04-01T15:23:58.132024+0000","last_undegraded":"2024-04-01T15:23:58.132024+0000","last_fullsized":"2024-04-01T15:23:58.132024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:58.131576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:58.131576+0000","last_clean_scrub_stamp":"2024-04-01T15:23:58.131576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:14:32.094793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.261287+0000","last_change":"2024-04-01T15:23:57.261287+0000","last_active":"2024-04-01T15:23:57.261287+0000","last_peered":"2024-04-01T15:23:57.261287+0000","last_clean":"2024-04-01T15:23:57.261287+0000","last_became_active":"2024-04-01T15:21:58.515500+0000","last_became_peered":"2024-04-01T15:21:58.515500+0000","last_unstale":"2024-04-01T15:23:57.261287+0000","last_undegraded":"2024-04-01T15:23:57.261287+0000","last_fullsized":"2024-04-01T15:23:57.261287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.261009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.261009+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.261009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:20:30.934716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:56.218319+0000","last_change":"2024-04-01T15:23:56.218319+0000","last_active":"2024-04-01T15:23:56.218319+0000","last_peered":"2024-04-01T15:23:56.218319+0000","last_clean":"2024-04-01T15:23:56.218319+0000","last_became_active":"2024-04-01T15:21:57.533218+0000","last_became_peered":"2024-04-01T15:21:57.533218+0000","last_unstale":"2024-04-01T15:23:56.218319+0000","last_undegraded":"2024-04-01T15:23:56.218319+0000","last_fullsized":"2024-04-01T15:23:56.218319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-01T15:23:56.217942+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-01T15:23:56.217942+0000","last_clean_scrub_stamp":"2024-04-01T15:23:56.217942+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:09:01.892555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.194089+0000","last_change":"2024-04-01T15:23:55.194089+0000","last_active":"2024-04-01T15:23:55.194089+0000","last_peered":"2024-04-01T15:23:55.194089+0000","last_clean":"2024-04-01T15:23:55.194089+0000","last_became_active":"2024-04-01T15:21:58.511891+0000","last_became_peered":"2024-04-01T15:21:58.511891+0000","last_unstale":"2024-04-01T15:23:55.194089+0000","last_undegraded":"2024-04-01T15:23:55.194089+0000","last_fullsized":"2024-04-01T15:23:55.194089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:23:55.193792+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:23:55.193792+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.193792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.204755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'3","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.439417+0000","last_change":"2024-04-01T15:23:57.439417+0000","last_active":"2024-04-01T15:23:57.439417+0000","last_peered":"2024-04-01T15:23:57.439417+0000","last_clean":"2024-04-01T15:23:57.439417+0000","last_became_active":"2024-04-01T15:21:57.525874+0000","last_became_peered":"2024-04-01T15:21:57.525874+0000","last_unstale":"2024-04-01T15:23:57.439417+0000","last_undegraded":"2024-04-01T15:23:57.439417+0000","last_fullsized":"2024-04-01T15:23:57.439417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:23:57.439157+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:23:57.439157+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.439157+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:18:18.650238+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.181208+0000","last_change":"2024-04-01T15:23:55.181208+0000","last_active":"2024-04-01T15:23:55.181208+0000","last_peered":"2024-04-01T15:23:55.181208+0000","last_clean":"2024-04-01T15:23:55.181208+0000","last_became_active":"2024-04-01T15:21:58.526100+0000","last_became_peered":"2024-04-01T15:21:58.526100+0000","last_unstale":"2024-04-01T15:23:55.181208+0000","last_undegraded":"2024-04-01T15:23:55.181208+0000","last_fullsized":"2024-04-01T15:23:55.181208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.181014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.181014+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.181014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:09:00.855628+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.112748+0000","last_change":"2024-04-01T15:24:00.112748+0000","last_active":"2024-04-01T15:24:00.112748+0000","last_peered":"2024-04-01T15:24:00.112748+0000","last_clean":"2024-04-01T15:24:00.112748+0000","last_became_active":"2024-04-01T15:21:57.526620+0000","last_became_peered":"2024-04-01T15:21:57.526620+0000","last_unstale":"2024-04-01T15:24:00.112748+0000","last_undegraded":"2024-04-01T15:24:00.112748+0000","last_fullsized":"2024-04-01T15:24:00.112748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.112411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.112411+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.112411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:05:41.343595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.530039+0000","last_change":"2024-04-01T15:23:55.530039+0000","last_active":"2024-04-01T15:23:55.530039+0000","last_peered":"2024-04-01T15:23:55.530039+0000","last_clean":"2024-04-01T15:23:55.530039+0000","last_became_active":"2024-04-01T15:21:58.528130+0000","last_became_peered":"2024-04-01T15:21:58.528130+0000","last_unstale":"2024-04-01T15:23:55.530039+0000","last_undegraded":"2024-04-01T15:23:55.530039+0000","last_fullsized":"2024-04-01T15:23:55.530039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.529792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.529792+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.529792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:47:54.039460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:53.184910+0000","last_change":"2024-04-01T15:23:53.184910+0000","last_active":"2024-04-01T15:23:53.184910+0000","last_peered":"2024-04-01T15:23:53.184910+0000","last_clean":"2024-04-01T15:23:53.184910+0000","last_became_active":"2024-04-01T15:21:57.522903+0000","last_became_peered":"2024-04-01T15:21:57.522903+0000","last_unstale":"2024-04-01T15:23:53.184910+0000","last_undegraded":"2024-04-01T15:23:53.184910+0000","last_fullsized":"2024-04-01T15:23:53.184910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:53.184674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:53.184674+0000","last_clean_scrub_stamp":"2024-04-01T15:23:53.184674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:38.146006+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:00.181191+0000","last_change":"2024-04-01T15:24:00.181191+0000","last_active":"2024-04-01T15:24:00.181191+0000","last_peered":"2024-04-01T15:24:00.181191+0000","last_clean":"2024-04-01T15:24:00.181191+0000","last_became_active":"2024-04-01T15:21:58.529135+0000","last_became_peered":"2024-04-01T15:21:58.529135+0000","last_unstale":"2024-04-01T15:24:00.181191+0000","last_undegraded":"2024-04-01T15:24:00.181191+0000","last_fullsized":"2024-04-01T15:24:00.181191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:00.180900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:00.180900+0000","last_clean_scrub_stamp":"2024-04-01T15:24:00.180900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:07:17.632748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:55.229210+0000","last_change":"2024-04-01T15:23:55.229210+0000","last_active":"2024-04-01T15:23:55.229210+0000","last_peered":"2024-04-01T15:23:55.229210+0000","last_clean":"2024-04-01T15:23:55.229210+0000","last_became_active":"2024-04-01T15:21:57.526251+0000","last_became_peered":"2024-04-01T15:21:57.526251+0000","last_unstale":"2024-04-01T15:23:55.229210+0000","last_undegraded":"2024-04-01T15:23:55.229210+0000","last_fullsized":"2024-04-01T15:23:55.229210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:55.229096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:55.229096+0000","last_clean_scrub_stamp":"2024-04-01T15:23:55.229096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:48:19.540795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:04.225361+0000","last_change":"2024-04-01T15:24:04.225361+0000","last_active":"2024-04-01T15:24:04.225361+0000","last_peered":"2024-04-01T15:24:04.225361+0000","last_clean":"2024-04-01T15:24:04.225361+0000","last_became_active":"2024-04-01T15:21:58.534019+0000","last_became_peered":"2024-04-01T15:21:58.534019+0000","last_unstale":"2024-04-01T15:24:04.225361+0000","last_undegraded":"2024-04-01T15:24:04.225361+0000","last_fullsized":"2024-04-01T15:24:04.225361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:04.225124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:04.225124+0000","last_clean_scrub_stamp":"2024-04-01T15:24:04.225124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:07:00.084982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.156991+0000","last_change":"2024-04-01T15:24:01.156991+0000","last_active":"2024-04-01T15:24:01.156991+0000","last_peered":"2024-04-01T15:24:01.156991+0000","last_clean":"2024-04-01T15:24:01.156991+0000","last_became_active":"2024-04-01T15:21:57.531135+0000","last_became_peered":"2024-04-01T15:21:57.531135+0000","last_unstale":"2024-04-01T15:24:01.156991+0000","last_undegraded":"2024-04-01T15:24:01.156991+0000","last_fullsized":"2024-04-01T15:24:01.156991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-01T15:24:01.156586+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-01T15:24:01.156586+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.156586+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:07:18.608434+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.339522+0000","last_change":"2024-04-01T15:24:03.339522+0000","last_active":"2024-04-01T15:24:03.339522+0000","last_peered":"2024-04-01T15:24:03.339522+0000","last_clean":"2024-04-01T15:24:03.339522+0000","last_became_active":"2024-04-01T15:21:58.523157+0000","last_became_peered":"2024-04-01T15:21:58.523157+0000","last_unstale":"2024-04-01T15:24:03.339522+0000","last_undegraded":"2024-04-01T15:24:03.339522+0000","last_fullsized":"2024-04-01T15:24:03.339522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:03.339266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:03.339266+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.339266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:43:22.281446+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:01.901721+0000","last_change":"2024-04-01T15:24:01.901721+0000","last_active":"2024-04-01T15:24:01.901721+0000","last_peered":"2024-04-01T15:24:01.901721+0000","last_clean":"2024-04-01T15:24:01.901721+0000","last_became_active":"2024-04-01T15:21:58.526135+0000","last_became_peered":"2024-04-01T15:21:58.526135+0000","last_unstale":"2024-04-01T15:24:01.901721+0000","last_undegraded":"2024-04-01T15:24:01.901721+0000","last_fullsized":"2024-04-01T15:24:01.901721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:01.901318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:01.901318+0000","last_clean_scrub_stamp":"2024-04-01T15:24:01.901318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:56:15.698933+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'3","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:03.109253+0000","last_change":"2024-04-01T15:24:03.109253+0000","last_active":"2024-04-01T15:24:03.109253+0000","last_peered":"2024-04-01T15:24:03.109253+0000","last_clean":"2024-04-01T15:24:03.109253+0000","last_became_active":"2024-04-01T15:21:57.534045+0000","last_became_peered":"2024-04-01T15:21:57.534045+0000","last_unstale":"2024-04-01T15:24:03.109253+0000","last_undegraded":"2024-04-01T15:24:03.109253+0000","last_fullsized":"2024-04-01T15:24:03.109253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-01T15:24:03.108974+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-01T15:24:03.108974+0000","last_clean_scrub_stamp":"2024-04-01T15:24:03.108974+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:31:58.634962+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:57.431563+0000","last_change":"2024-04-01T15:23:57.431622+0000","last_active":"2024-04-01T15:23:57.431563+0000","last_peered":"2024-04-01T15:23:57.431563+0000","last_clean":"2024-04-01T15:23:57.431563+0000","last_became_active":"2024-04-01T15:22:39.750255+0000","last_became_peered":"2024-04-01T15:22:39.750255+0000","last_unstale":"2024-04-01T15:23:57.431563+0000","last_undegraded":"2024-04-01T15:23:57.431563+0000","last_fullsized":"2024-04-01T15:23:57.431563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:57.431381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:57.431381+0000","last_clean_scrub_stamp":"2024-04-01T15:23:57.431381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:18:55.440544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:02.125175+0000","last_change":"2024-04-01T15:24:02.125175+0000","last_active":"2024-04-01T15:24:02.125175+0000","last_peered":"2024-04-01T15:24:02.125175+0000","last_clean":"2024-04-01T15:24:02.125175+0000","last_became_active":"2024-04-01T15:21:57.533414+0000","last_became_peered":"2024-04-01T15:21:57.533414+0000","last_unstale":"2024-04-01T15:24:02.125175+0000","last_undegraded":"2024-04-01T15:24:02.125175+0000","last_fullsized":"2024-04-01T15:24:02.125175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-01T15:24:02.124951+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-01T15:24:02.124951+0000","last_clean_scrub_stamp":"2024-04-01T15:24:02.124951+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:50:31.177202+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:52.201141+0000","last_change":"2024-04-01T15:23:52.201141+0000","last_active":"2024-04-01T15:23:52.201141+0000","last_peered":"2024-04-01T15:23:52.201141+0000","last_clean":"2024-04-01T15:23:52.201141+0000","last_became_active":"2024-04-01T15:21:58.521784+0000","last_became_peered":"2024-04-01T15:21:58.521784+0000","last_unstale":"2024-04-01T15:23:52.201141+0000","last_undegraded":"2024-04-01T15:23:52.201141+0000","last_fullsized":"2024-04-01T15:23:52.201141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:23:52.200810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:23:52.200810+0000","last_clean_scrub_stamp":"2024-04-01T15:23:52.200810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:37.162142+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:53.228145+0000","last_change":"2024-04-01T15:23:53.228145+0000","last_active":"2024-04-01T15:23:53.228145+0000","last_peered":"2024-04-01T15:23:53.228145+0000","last_clean":"2024-04-01T15:23:53.228145+0000","last_became_active":"2024-04-01T15:21:57.518748+0000","last_became_peered":"2024-04-01T15:21:57.518748+0000","last_unstale":"2024-04-01T15:23:53.228145+0000","last_undegraded":"2024-04-01T15:23:53.228145+0000","last_fullsized":"2024-04-01T15:23:53.228145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-01T15:23:53.227857+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-01T15:23:53.227857+0000","last_clean_scrub_stamp":"2024-04-01T15:23:53.227857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:18:14.438938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:24:05.227886+0000","last_change":"2024-04-01T15:24:05.227941+0000","last_active":"2024-04-01T15:24:05.227886+0000","last_peered":"2024-04-01T15:24:05.227886+0000","last_clean":"2024-04-01T15:24:05.227886+0000","last_became_active":"2024-04-01T15:21:58.536082+0000","last_became_peered":"2024-04-01T15:21:58.536082+0000","last_unstale":"2024-04-01T15:24:05.227886+0000","last_undegraded":"2024-04-01T15:24:05.227886+0000","last_fullsized":"2024-04-01T15:24:05.227886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T15:24:05.227619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T15:24:05.227619+0000","last_clean_scrub_stamp":"2024-04-01T15:24:05.227619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:41:49.948095+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'6","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-01T15:23:51.218476+0000","last_change":"2024-04-01T15:23:51.218476+0000","last_active":"2024-04-01T15:23:51.218476+0000","last_peered":"2024-04-01T15:23:51.218476+0000","last_clean":"2024-04-01T15:23:51.218476+0000","last_became_active":"2024-04-01T15:21:57.524085+0000","last_became_peered":"2024-04-01T15:21:57.524085+0000","last_unstale":"2024-04-01T15:23:51.218476+0000","last_undegraded":"2024-04-01T15:23:51.218476+0000","last_fullsized":"2024-04-01T15:23:51.218476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-01T15:23:51.218306+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-01T15:23:51.218306+0000","last_clean_scrub_stamp":"2024-04-01T15:23:51.218306+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:19:38.238216+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":35041,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":82,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5111,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":70082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":827392,"data_stored":674074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":117064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":83250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":117367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":674130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":34243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":33940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T15:24:37.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-01T15:24:37.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.596+0000 7fe248400640 1 Processor -- start 2024-04-01T15:24:37.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.596+0000 7fe248400640 1 -- start start 2024-04-01T15:24:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.597+0000 7fe248400640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe24009deb0 0x7fe2400ae840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.597+0000 7fe248400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2400b3e30 0x7fe24014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.597+0000 7fe248400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24006cf10 con 0x7fe2400ae220 2024-04-01T15:24:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.597+0000 7fe248400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe2400b2f10 con 0x7fe2400b3e30 2024-04-01T15:24:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.597+0000 7fe248400640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe2400b03c0 con 0x7fe24009deb0 2024-04-01T15:24:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.598+0000 7fe245000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe2400ae220 0x7fe2400b3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35714/0 (socket says 172.21.15.142:35714) 2024-04-01T15:24:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.598+0000 7fe245000640 1 -- 172.21.15.142:0/83506208 learned_addr learned my addr 172.21.15.142:0/83506208 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:24:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.598+0000 7fe246400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2400b3e30 0x7fe24014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.598+0000 7fe245a00640 1 --2- 172.21.15.142:0/83506208 >> v2:172.21.15.179:3300/0 conn(0x7fe24009deb0 0x7fe2400ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.598+0000 7fe246400640 1 -- 172.21.15.142:0/83506208 >> v2:172.21.15.179:3300/0 conn(0x7fe24009deb0 msgr2=0x7fe2400ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.598+0000 7fe246400640 1 --2- 172.21.15.142:0/83506208 >> v2:172.21.15.179:3300/0 conn(0x7fe24009deb0 0x7fe2400ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.598+0000 7fe246400640 1 -- 172.21.15.142:0/83506208 >> v1:172.21.15.142:6789/0 conn(0x7fe2400ae220 legacy=0x7fe2400b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.598+0000 7fe246400640 1 -- 172.21.15.142:0/83506208 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24009e290 con 0x7fe2400b3e30 2024-04-01T15:24:37.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.598+0000 7fe23fe00640 1 -- 172.21.15.142:0/83506208 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779001329 0 0) 0x7fe24006cf10 con 0x7fe2400ae220 2024-04-01T15:24:37.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.599+0000 7fe246400640 1 --2- 172.21.15.142:0/83506208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 0x7fe24014ebb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe24006db10 tx=0x7fe23802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fb8652887483b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:37.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe23fe00640 1 -- 172.21.15.142:0/83506208 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238039070 con 0x7fe2400b3e30 2024-04-01T15:24:37.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe23fe00640 1 -- 172.21.15.142:0/83506208 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23802cb60 con 0x7fe2400b3e30 2024-04-01T15:24:37.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe23fe00640 1 -- 172.21.15.142:0/83506208 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238034440 con 0x7fe2400b3e30 2024-04-01T15:24:37.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe248400640 1 -- 172.21.15.142:0/83506208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 msgr2=0x7fe24014ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe248400640 1 --2- 172.21.15.142:0/83506208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 0x7fe24014ebb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe24006db10 tx=0x7fe23802bdb0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe248400640 1 -- 172.21.15.142:0/83506208 shutdown_connections 2024-04-01T15:24:37.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe248400640 1 --2- 172.21.15.142:0/83506208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 0x7fe24014ebb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe248400640 1 --2- 172.21.15.142:0/83506208 >> v2:172.21.15.179:3300/0 conn(0x7fe24009deb0 0x7fe2400ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe248400640 1 -- 172.21.15.142:0/83506208 >> 172.21.15.142:0/83506208 conn(0x7fe2400b8f00 msgr2=0x7fe2400b92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:37.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe248400640 1 -- 172.21.15.142:0/83506208 shutdown_connections 2024-04-01T15:24:37.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.600+0000 7fe248400640 1 -- 172.21.15.142:0/83506208 wait complete. 2024-04-01T15:24:37.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.602+0000 7fe248400640 1 Processor -- start 2024-04-01T15:24:37.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.602+0000 7fe248400640 1 -- start start 2024-04-01T15:24:37.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe248400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe24009deb0 0x7fe2400720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe248400640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2400ae220 0x7fe2400708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe248400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 0x7fe2401dd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe248400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400add40 con 0x7fe2400b3e30 2024-04-01T15:24:37.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe248400640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400afc00 con 0x7fe2400ae220 2024-04-01T15:24:37.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe248400640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe2400adec0 con 0x7fe24009deb0 2024-04-01T15:24:37.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe246400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 0x7fe2401dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe246400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 0x7fe2401dd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59030/0 (socket says 172.21.15.142:59030) 2024-04-01T15:24:37.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe246400640 1 -- 172.21.15.142:0/1385282100 learned_addr learned my addr 172.21.15.142:0/1385282100 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:37.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe245a00640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe24009deb0 0x7fe2400720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe245000640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2400ae220 0x7fe2400708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe246400640 1 -- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe24009deb0 msgr2=0x7fe2400720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe246400640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe24009deb0 0x7fe2400720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe246400640 1 -- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2400ae220 msgr2=0x7fe2400708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe246400640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2400ae220 0x7fe2400708e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe246400640 1 -- 172.21.15.142:0/1385282100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24014cdb0 con 0x7fe2400b3e30 2024-04-01T15:24:37.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.603+0000 7fe245000640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2400ae220 0x7fe2400708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:24:37.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.604+0000 7fe246400640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 0x7fe2401dd000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe238009e80 tx=0x7fe238004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:37.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.604+0000 7fe23d600640 1 -- 172.21.15.142:0/1385282100 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238039050 con 0x7fe2400b3e30 2024-04-01T15:24:37.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.604+0000 7fe23d600640 1 -- 172.21.15.142:0/1385282100 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23803a040 con 0x7fe2400b3e30 2024-04-01T15:24:37.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.604+0000 7fe23d600640 1 -- 172.21.15.142:0/1385282100 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23803e610 con 0x7fe2400b3e30 2024-04-01T15:24:37.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.604+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2401501e0 con 0x7fe2400b3e30 2024-04-01T15:24:37.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.604+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24014cad0 con 0x7fe2400b3e30 2024-04-01T15:24:37.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.605+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe240068710 con 0x7fe2400b3e30 2024-04-01T15:24:37.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.606+0000 7fe23d600640 1 -- 172.21.15.142:0/1385282100 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe238047020 con 0x7fe2400b3e30 2024-04-01T15:24:37.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.607+0000 7fe23d600640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe22006c8f0 0x7fe22006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:37.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.607+0000 7fe23d600640 1 -- 172.21.15.142:0/1385282100 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe2380aded0 con 0x7fe2400b3e30 2024-04-01T15:24:37.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.608+0000 7fe245a00640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe22006c8f0 0x7fe22006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:37.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.609+0000 7fe245a00640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe22006c8f0 0x7fe22006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe234006fd0 tx=0x7fe234008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:37.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.612+0000 7fe23d600640 1 -- 172.21.15.142:0/1385282100 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe23804e020 con 0x7fe2400b3e30 2024-04-01T15:24:37.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.814+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe2400b10b0 con 0x7fe2400b3e30 2024-04-01T15:24:37.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.820+0000 7fe23d600640 1 -- 172.21.15.142:0/1385282100 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fe23807c310 con 0x7fe2400b3e30 2024-04-01T15:24:37.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.822+0000 7fe23d600640 1 -- 172.21.15.142:0/1385282100 <== mon.0 v2:172.21.15.142:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe23807bc10 con 0x7fe2400b3e30 2024-04-01T15:24:37.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe22006c8f0 msgr2=0x7fe22006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe22006c8f0 0x7fe22006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe234006fd0 tx=0x7fe234008040 comp rx=0 tx=0).stop 2024-04-01T15:24:37.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 msgr2=0x7fe2401dd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:37.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 0x7fe2401dd000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe238009e80 tx=0x7fe238004a40 comp rx=0 tx=0).stop 2024-04-01T15:24:37.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 shutdown_connections 2024-04-01T15:24:37.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7fe22006c8f0 0x7fe22006edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2400b3e30 0x7fe2401dd000 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2400ae220 0x7fe2400708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 --2- 172.21.15.142:0/1385282100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe24009deb0 0x7fe2400720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:37.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 >> 172.21.15.142:0/1385282100 conn(0x7fe2400b8f00 msgr2=0x7fe2400b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:37.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.824+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 shutdown_connections 2024-04-01T15:24:37.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:37.825+0000 7fe248400640 1 -- 172.21.15.142:0/1385282100 wait complete. 2024-04-01T15:24:37.843 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-01T15:24:37.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T15:24:38.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.052+0000 7f1156c00640 1 Processor -- start 2024-04-01T15:24:38.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.053+0000 7f1156c00640 1 -- start start 2024-04-01T15:24:38.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.054+0000 7f1156c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11500b4af0 0x7f1150141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.054+0000 7f1156c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 0x7f1150141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.054+0000 7f1156c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11500b4ed0 con 0x7f11500b5790 2024-04-01T15:24:38.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.054+0000 7f1156c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f115006b6a0 con 0x7f11500b4af0 2024-04-01T15:24:38.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.054+0000 7f1156c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f115006b980 con 0x7f11500b5120 2024-04-01T15:24:38.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.054+0000 7f114f400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f11500b5790 0x7f115014b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35720/0 (socket says 172.21.15.142:35720) 2024-04-01T15:24:38.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.054+0000 7f114f400640 1 -- 172.21.15.142:0/3692040679 learned_addr learned my addr 172.21.15.142:0/3692040679 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:24:38.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.054+0000 7f114fe00640 1 --2- 172.21.15.142:0/3692040679 >> v2:172.21.15.142:3300/0 conn(0x7f11500b4af0 0x7f1150141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.055+0000 7f1154c00640 1 --2- 172.21.15.142:0/3692040679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 0x7f1150141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.055+0000 7f114ea00640 1 -- 172.21.15.142:0/3692040679 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59393245 0 0) 0x7f11500b4ed0 con 0x7f11500b5790 2024-04-01T15:24:38.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.055+0000 7f114fe00640 1 -- 172.21.15.142:0/3692040679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 msgr2=0x7f1150141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:38.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.055+0000 7f114fe00640 1 --2- 172.21.15.142:0/3692040679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 0x7f1150141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.055+0000 7f114fe00640 1 -- 172.21.15.142:0/3692040679 >> v1:172.21.15.142:6789/0 conn(0x7f11500b5790 legacy=0x7f115014b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.055+0000 7f114fe00640 1 -- 172.21.15.142:0/3692040679 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115006bc60 con 0x7f11500b4af0 2024-04-01T15:24:38.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.056+0000 7f114fe00640 1 --2- 172.21.15.142:0/3692040679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 0x7f1150141660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f11400097a0 tx=0x7f114002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b05de93d0987027 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:38.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.056+0000 7f114ea00640 1 -- 172.21.15.142:0/3692040679 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400315a0 con 0x7f11500b4af0 2024-04-01T15:24:38.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.056+0000 7f114ea00640 1 -- 172.21.15.142:0/3692040679 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1140037070 con 0x7f11500b4af0 2024-04-01T15:24:38.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.056+0000 7f114ea00640 1 -- 172.21.15.142:0/3692040679 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140031980 con 0x7f11500b4af0 2024-04-01T15:24:38.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.057+0000 7f1156c00640 1 -- 172.21.15.142:0/3692040679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 msgr2=0x7f1150141660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.057+0000 7f1156c00640 1 --2- 172.21.15.142:0/3692040679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 0x7f1150141660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f11400097a0 tx=0x7f114002b840 comp rx=0 tx=0).stop 2024-04-01T15:24:38.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.057+0000 7f1156c00640 1 -- 172.21.15.142:0/3692040679 shutdown_connections 2024-04-01T15:24:38.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.057+0000 7f1156c00640 1 --2- 172.21.15.142:0/3692040679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 0x7f1150141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.057+0000 7f1156c00640 1 --2- 172.21.15.142:0/3692040679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 0x7f1150141660 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.057+0000 7f1156c00640 1 -- 172.21.15.142:0/3692040679 >> 172.21.15.142:0/3692040679 conn(0x7f115006c630 msgr2=0x7f115006ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:38.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.057+0000 7f1156c00640 1 -- 172.21.15.142:0/3692040679 shutdown_connections 2024-04-01T15:24:38.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.057+0000 7f1156c00640 1 -- 172.21.15.142:0/3692040679 wait complete. 2024-04-01T15:24:38.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.058+0000 7f1156c00640 1 Processor -- start 2024-04-01T15:24:38.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.059+0000 7f1156c00640 1 -- start start 2024-04-01T15:24:38.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.059+0000 7f1156c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 0x7f1150148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.059+0000 7f1156c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 0x7f11501458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.059+0000 7f1156c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11500b5790 0x7f1150145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.059+0000 7f1156c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f115014b7e0 con 0x7f11500b4af0 2024-04-01T15:24:38.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.059+0000 7f1156c00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f115014b960 con 0x7f11500b5790 2024-04-01T15:24:38.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.059+0000 7f1156c00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f11500b4330 con 0x7f11500b5120 2024-04-01T15:24:38.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.059+0000 7f114fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 0x7f1150148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 0x7f1150148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59054/0 (socket says 172.21.15.142:59054) 2024-04-01T15:24:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114fe00640 1 -- 172.21.15.142:0/3715317568 learned_addr learned my addr 172.21.15.142:0/3715317568 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114f400640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 0x7f11501458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f1154c00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11500b5790 0x7f1150145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114fe00640 1 -- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 msgr2=0x7f11501458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114fe00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 0x7f11501458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114fe00640 1 -- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11500b5790 msgr2=0x7f1150145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114fe00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11500b5790 0x7f1150145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114fe00640 1 -- 172.21.15.142:0/3715317568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1150144c90 con 0x7f11500b4af0 2024-04-01T15:24:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114f400640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 0x7f11501458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:24:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f114fe00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 0x7f1150148110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1140000c00 tx=0x7f11400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.060+0000 7f1147e00640 1 -- 172.21.15.142:0/3715317568 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140004220 con 0x7f11500b4af0 2024-04-01T15:24:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.061+0000 7f1147e00640 1 -- 172.21.15.142:0/3715317568 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f11400043c0 con 0x7f11500b4af0 2024-04-01T15:24:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.061+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11501476a0 con 0x7f11500b4af0 2024-04-01T15:24:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.061+0000 7f1147e00640 1 -- 172.21.15.142:0/3715317568 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140032880 con 0x7f11500b4af0 2024-04-01T15:24:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.061+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1150143a40 con 0x7f11500b4af0 2024-04-01T15:24:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.062+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1150145030 con 0x7f11500b4af0 2024-04-01T15:24:38.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.063+0000 7f1147e00640 1 -- 172.21.15.142:0/3715317568 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1140032a20 con 0x7f11500b4af0 2024-04-01T15:24:38.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.064+0000 7f1147e00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f112c06c8f0 0x7f112c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.064+0000 7f1147e00640 1 -- 172.21.15.142:0/3715317568 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f114002f030 con 0x7f11500b4af0 2024-04-01T15:24:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.065+0000 7f114f400640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f112c06c8f0 0x7f112c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.066+0000 7f114f400640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f112c06c8f0 0x7f112c06edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1150152150 tx=0x7f1138009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:38.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.069+0000 7f1147e00640 1 -- 172.21.15.142:0/3715317568 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1150145030 con 0x7f11500b4af0 2024-04-01T15:24:38.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.292+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1150144aa0 con 0x7f11500b4af0 2024-04-01T15:24:38.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.294+0000 7f1147e00640 1 -- 172.21.15.142:0/3715317568 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3533 (secure 0 0 0) 0x7f114004b060 con 0x7f11500b4af0 2024-04-01T15:24:38.295 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:24:38.295 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1407766362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1407766362},{"type":"v1","addr":"172.21.15.142:6833","nonce":1407766362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T15:21:57.963541+0000","modified":"2024-04-01T15:22:01.028534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1191595510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1191595510},{"type":"v1","addr":"172.21.15.179:6835","nonce":1191595510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T15:24:38.295 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2024-04-01T15:24:38.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.296+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f112c06c8f0 msgr2=0x7f112c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.296+0000 7f1156c00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f112c06c8f0 0x7f112c06edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1150152150 tx=0x7f1138009040 comp rx=0 tx=0).stop 2024-04-01T15:24:38.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.296+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 msgr2=0x7f1150148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.296+0000 7f1156c00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 0x7f1150148110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1140000c00 tx=0x7f11400046c0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.297+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 shutdown_connections 2024-04-01T15:24:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.297+0000 7f1156c00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f112c06c8f0 0x7f112c06edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.297+0000 7f1156c00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11500b5790 0x7f1150145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.297+0000 7f1156c00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11500b5120 0x7f11501458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.297+0000 7f1156c00640 1 --2- 172.21.15.142:0/3715317568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11500b4af0 0x7f1150148110 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.297+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 >> 172.21.15.142:0/3715317568 conn(0x7f115006c630 msgr2=0x7f115013c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.297+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 shutdown_connections 2024-04-01T15:24:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.297+0000 7f1156c00640 1 -- 172.21.15.142:0/3715317568 wait complete. 2024-04-01T15:24:38.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T15:24:38.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.517+0000 7f59f1000640 1 Processor -- start 2024-04-01T15:24:38.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.518+0000 7f59f1000640 1 -- start start 2024-04-01T15:24:38.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.518+0000 7f59f1000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59ec06d8d0 0x7f59ec0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59f1000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59ec0b1410 0x7f59ec14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59f1000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec06dcb0 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59f1000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f59ec0b0b20 con 0x7f59ec06d8d0 2024-04-01T15:24:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59f1000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f59ec148ad0 con 0x7f59ec0b1410 2024-04-01T15:24:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59e9400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f59ec0b0fb0 0x7f59ec1491e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35736/0 (socket says 172.21.15.142:35736) 2024-04-01T15:24:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59e9400640 1 -- 172.21.15.142:0/1474478390 learned_addr learned my addr 172.21.15.142:0/1474478390 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:24:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59e9e00640 1 --2- 172.21.15.142:0/1474478390 >> v2:172.21.15.142:3300/0 conn(0x7f59ec06d8d0 0x7f59ec0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59ea800640 1 --2- 172.21.15.142:0/1474478390 >> v2:172.21.15.179:3300/0 conn(0x7f59ec0b1410 0x7f59ec14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59e9e00640 1 -- 172.21.15.142:0/1474478390 >> v2:172.21.15.179:3300/0 conn(0x7f59ec0b1410 msgr2=0x7f59ec14fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59e9e00640 1 --2- 172.21.15.142:0/1474478390 >> v2:172.21.15.179:3300/0 conn(0x7f59ec0b1410 0x7f59ec14fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59e9e00640 1 -- 172.21.15.142:0/1474478390 >> v1:172.21.15.142:6789/0 conn(0x7f59ec0b0fb0 legacy=0x7f59ec1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59e9e00640 1 -- 172.21.15.142:0/1474478390 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec0b5230 con 0x7f59ec06d8d0 2024-04-01T15:24:38.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.519+0000 7f59e8a00640 1 -- 172.21.15.142:0/1474478390 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369494386 0 0) 0x7f59ec06dcb0 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.521+0000 7f59e9e00640 1 --2- 172.21.15.142:0/1474478390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec06d8d0 0x7f59ec0b2d20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0b4ba0 tx=0x7f59dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3c24f7ee4e4b70 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:38.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.521+0000 7f59e8a00640 1 -- 172.21.15.142:0/1474478390 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc035020 con 0x7f59ec06d8d0 2024-04-01T15:24:38.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.521+0000 7f59e8a00640 1 -- 172.21.15.142:0/1474478390 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f59dc031830 con 0x7f59ec06d8d0 2024-04-01T15:24:38.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.521+0000 7f59e8a00640 1 -- 172.21.15.142:0/1474478390 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc031c20 con 0x7f59ec06d8d0 2024-04-01T15:24:38.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.522+0000 7f59f1000640 1 -- 172.21.15.142:0/1474478390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec06d8d0 msgr2=0x7f59ec0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.522+0000 7f59f1000640 1 --2- 172.21.15.142:0/1474478390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec06d8d0 0x7f59ec0b2d20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0b4ba0 tx=0x7f59dc02b8d0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.522+0000 7f59f1000640 1 -- 172.21.15.142:0/1474478390 shutdown_connections 2024-04-01T15:24:38.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.522+0000 7f59f1000640 1 --2- 172.21.15.142:0/1474478390 >> v2:172.21.15.179:3300/0 conn(0x7f59ec0b1410 0x7f59ec14fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.522+0000 7f59f1000640 1 --2- 172.21.15.142:0/1474478390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec06d8d0 0x7f59ec0b2d20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.522+0000 7f59f1000640 1 -- 172.21.15.142:0/1474478390 >> 172.21.15.142:0/1474478390 conn(0x7f59ec0b5890 msgr2=0x7f59ec0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:38.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.522+0000 7f59f1000640 1 -- 172.21.15.142:0/1474478390 shutdown_connections 2024-04-01T15:24:38.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.522+0000 7f59f1000640 1 -- 172.21.15.142:0/1474478390 wait complete. 2024-04-01T15:24:38.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.523+0000 7f59f1000640 1 Processor -- start 2024-04-01T15:24:38.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.523+0000 7f59f1000640 1 -- start start 2024-04-01T15:24:38.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.524+0000 7f59f1000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec06d8d0 0x7f59ec145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.524+0000 7f59f1000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec0b0fb0 0x7f59ec1dd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.524+0000 7f59f1000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec0b1410 0x7f59ec1dd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.524+0000 7f59f1000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec1498f0 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.524+0000 7f59f1000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec0b4e50 con 0x7f59ec0b1410 2024-04-01T15:24:38.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.524+0000 7f59f1000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f59ec070d30 con 0x7f59ec06d8d0 2024-04-01T15:24:38.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.524+0000 7f59e9400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec0b0fb0 0x7f59ec1dd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.524+0000 7f59e9400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec0b0fb0 0x7f59ec1dd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59072/0 (socket says 172.21.15.142:59072) 2024-04-01T15:24:38.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.524+0000 7f59e9400640 1 -- 172.21.15.142:0/359783506 learned_addr learned my addr 172.21.15.142:0/359783506 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:38.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.525+0000 7f59e9e00640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec06d8d0 0x7f59ec145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.525+0000 7f59ea800640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec0b1410 0x7f59ec1dd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.525+0000 7f59e9400640 1 -- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec06d8d0 msgr2=0x7f59ec145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.525+0000 7f59e9400640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec06d8d0 0x7f59ec145850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.525+0000 7f59e9400640 1 -- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec0b1410 msgr2=0x7f59ec1dd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.525+0000 7f59e9400640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec0b1410 0x7f59ec1dd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.525+0000 7f59e9400640 1 -- 172.21.15.142:0/359783506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec140ef0 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.525+0000 7f59e9400640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec0b0fb0 0x7f59ec1dd470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59d800c500 tx=0x7f59d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:38.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.525+0000 7f59e2000640 1 -- 172.21.15.142:0/359783506 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8018070 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.526+0000 7f59e2000640 1 -- 172.21.15.142:0/359783506 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f59d8007580 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.526+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec1e0ee0 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.526+0000 7f59e2000640 1 -- 172.21.15.142:0/359783506 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8004a40 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.526+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec1e14a0 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.527+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec068710 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.528+0000 7f59e2000640 1 -- 172.21.15.142:0/359783506 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59d801b070 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.530+0000 7f59e2000640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f59cc06c8f0 0x7f59cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:38.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.530+0000 7f59e2000640 1 -- 172.21.15.142:0/359783506 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f59d808af00 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.530+0000 7f59e9e00640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f59cc06c8f0 0x7f59cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:38.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.532+0000 7f59e9e00640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f59cc06c8f0 0x7f59cc06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f59dc036000 tx=0x7f59dc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:38.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.535+0000 7f59e2000640 1 -- 172.21.15.142:0/359783506 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f59d80592a0 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.776+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59ec1e1670 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.777+0000 7f59e2000640 1 -- 172.21.15.142:0/359783506 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3533 (secure 0 0 0) 0x7f59d8058ba0 con 0x7f59ec0b0fb0 2024-04-01T15:24:38.778 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:24:38.778 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/1407766362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1407766362},{"type":"v1","addr":"172.21.15.142:6833","nonce":1407766362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T15:21:57.963541+0000","modified":"2024-04-01T15:22:01.028534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1191595510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1191595510},{"type":"v1","addr":"172.21.15.179:6835","nonce":1191595510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T15:24:38.779 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2024-04-01T15:24:38.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f59cc06c8f0 msgr2=0x7f59cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f59cc06c8f0 0x7f59cc06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f59dc036000 tx=0x7f59dc03c040 comp rx=0 tx=0).stop 2024-04-01T15:24:38.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec0b0fb0 msgr2=0x7f59ec1dd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:38.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec0b0fb0 0x7f59ec1dd470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59d800c500 tx=0x7f59d800c9c0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 shutdown_connections 2024-04-01T15:24:38.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f59cc06c8f0 0x7f59cc06edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59ec0b1410 0x7f59ec1dd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ec0b0fb0 0x7f59ec1dd470 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 --2- 172.21.15.142:0/359783506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59ec06d8d0 0x7f59ec145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:38.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.779+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 >> 172.21.15.142:0/359783506 conn(0x7f59ec0b5890 msgr2=0x7f59ec0b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:38.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.780+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 shutdown_connections 2024-04-01T15:24:38.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:38.780+0000 7f59f1000640 1 -- 172.21.15.142:0/359783506 wait complete. 2024-04-01T15:24:38.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T15:24:39.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.004+0000 7f4f4b000640 1 Processor -- start 2024-04-01T15:24:39.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.004+0000 7f4f4b000640 1 -- start start 2024-04-01T15:24:39.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.006+0000 7f4f4b000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f4406d8d0 0x7f4f440ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.006+0000 7f4f4b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f440b0290 0x7f4f440aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.006+0000 7f4f4b000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4406dcb0 con 0x7f4f44147be0 2024-04-01T15:24:39.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.006+0000 7f4f4b000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4f440b1790 con 0x7f4f4406d8d0 2024-04-01T15:24:39.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.006+0000 7f4f4b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4f440b14b0 con 0x7f4f440b0290 2024-04-01T15:24:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.006+0000 7f4f43e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f4406d8d0 0x7f4f440ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.006+0000 7f4f3b400640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f440b0290 0x7f4f440aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.006+0000 7f4f43e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f4406d8d0 0x7f4f440ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59074/0 (socket says 172.21.15.142:59074) 2024-04-01T15:24:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.006+0000 7f4f43e00640 1 -- 172.21.15.142:0/416591590 learned_addr learned my addr 172.21.15.142:0/416591590 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.007+0000 7f4f43e00640 1 -- 172.21.15.142:0/416591590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f440b0290 msgr2=0x7f4f440aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.007+0000 7f4f43e00640 1 --2- 172.21.15.142:0/416591590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f440b0290 0x7f4f440aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.007+0000 7f4f43e00640 1 -- 172.21.15.142:0/416591590 >> v1:172.21.15.179:6789/0 conn(0x7f4f44147be0 legacy=0x7f4f44148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.007+0000 7f4f43e00640 1 -- 172.21.15.142:0/416591590 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f440b53b0 con 0x7f4f4406d8d0 2024-04-01T15:24:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.008+0000 7f4f43e00640 1 --2- 172.21.15.142:0/416591590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f4406d8d0 0x7f4f440ae890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009870 tx=0x7f4f3402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542cd65cc6a8ead3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:39.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.008+0000 7f4f43400640 1 -- 172.21.15.142:0/416591590 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34034070 con 0x7f4f4406d8d0 2024-04-01T15:24:39.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.008+0000 7f4f43400640 1 -- 172.21.15.142:0/416591590 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4f34030840 con 0x7f4f4406d8d0 2024-04-01T15:24:39.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.008+0000 7f4f43400640 1 -- 172.21.15.142:0/416591590 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34030c30 con 0x7f4f4406d8d0 2024-04-01T15:24:39.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.009+0000 7f4f4b000640 1 -- 172.21.15.142:0/416591590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f4406d8d0 msgr2=0x7f4f440ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.009+0000 7f4f4b000640 1 --2- 172.21.15.142:0/416591590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f4406d8d0 0x7f4f440ae890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009870 tx=0x7f4f3402b980 comp rx=0 tx=0).stop 2024-04-01T15:24:39.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.009+0000 7f4f4b000640 1 -- 172.21.15.142:0/416591590 shutdown_connections 2024-04-01T15:24:39.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.009+0000 7f4f4b000640 1 --2- 172.21.15.142:0/416591590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f440b0290 0x7f4f440aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.009+0000 7f4f4b000640 1 --2- 172.21.15.142:0/416591590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f4406d8d0 0x7f4f440ae890 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.009+0000 7f4f4b000640 1 -- 172.21.15.142:0/416591590 >> 172.21.15.142:0/416591590 conn(0x7f4f440b5890 msgr2=0x7f4f440b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:39.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.009+0000 7f4f4b000640 1 -- 172.21.15.142:0/416591590 shutdown_connections 2024-04-01T15:24:39.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.009+0000 7f4f4b000640 1 -- 172.21.15.142:0/416591590 wait complete. 2024-04-01T15:24:39.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.011+0000 7f4f4b000640 1 Processor -- start 2024-04-01T15:24:39.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.011+0000 7f4f4b000640 1 -- start start 2024-04-01T15:24:39.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f4b000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f4406d8d0 0x7f4f4413a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f4b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f440b0290 0x7f4f441deb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f4b000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f44147be0 0x7f4f44146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f4b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4f440ae370 con 0x7f4f440b0290 2024-04-01T15:24:39.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f4b000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4f440ae090 con 0x7f4f4406d8d0 2024-04-01T15:24:39.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f4b000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4f44148760 con 0x7f4f44147be0 2024-04-01T15:24:39.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f3b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f440b0290 0x7f4f441deb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f3b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f440b0290 0x7f4f441deb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59076/0 (socket says 172.21.15.142:59076) 2024-04-01T15:24:39.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f3b400640 1 -- 172.21.15.142:0/2259280036 learned_addr learned my addr 172.21.15.142:0/2259280036 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:39.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f43e00640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f4406d8d0 0x7f4f4413a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.012+0000 7f4f49000640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f44147be0 0x7f4f44146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f3b400640 1 -- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f44147be0 msgr2=0x7f4f44146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f3b400640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f44147be0 0x7f4f44146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f3b400640 1 -- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f4406d8d0 msgr2=0x7f4f4413a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f3b400640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f4406d8d0 0x7f4f4413a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f3b400640 1 -- 172.21.15.142:0/2259280036 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f44145d00 con 0x7f4f440b0290 2024-04-01T15:24:39.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f3b400640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f440b0290 0x7f4f441deb10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00e9e0 tx=0x7f4f2c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:39.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f40c00640 1 -- 172.21.15.142:0/2259280036 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c017070 con 0x7f4f440b0290 2024-04-01T15:24:39.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f40c00640 1 -- 172.21.15.142:0/2259280036 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4f2c00c9d0 con 0x7f4f440b0290 2024-04-01T15:24:39.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f40c00640 1 -- 172.21.15.142:0/2259280036 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00cde0 con 0x7f4f440b0290 2024-04-01T15:24:39.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.013+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f44139a60 con 0x7f4f440b0290 2024-04-01T15:24:39.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.014+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f44145a20 con 0x7f4f440b0290 2024-04-01T15:24:39.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.015+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f44068710 con 0x7f4f440b0290 2024-04-01T15:24:39.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.015+0000 7f4f40c00640 1 -- 172.21.15.142:0/2259280036 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f2c01a070 con 0x7f4f440b0290 2024-04-01T15:24:39.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.017+0000 7f4f40c00640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4f2006c920 0x7f4f2006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.017+0000 7f4f40c00640 1 -- 172.21.15.142:0/2259280036 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f4f2c08bc80 con 0x7f4f440b0290 2024-04-01T15:24:39.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.017+0000 7f4f43e00640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4f2006c920 0x7f4f2006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.018+0000 7f4f43e00640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4f2006c920 0x7f4f2006ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4f34036000 tx=0x7f4f3403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:39.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.022+0000 7f4f40c00640 1 -- 172.21.15.142:0/2259280036 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4f2c05a020 con 0x7f4f440b0290 2024-04-01T15:24:39.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.221+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f440b7490 con 0x7f4f440b0290 2024-04-01T15:24:39.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.224+0000 7f4f40c00640 1 -- 172.21.15.142:0/2259280036 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16877 (secure 0 0 0) 0x7f4f2c059920 con 0x7f4f440b0290 2024-04-01T15:24:39.225 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-01T15:24:39.226 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":22,"fsid":"6c6b3e6d-5c47-47ee-94b2-ea6975c6e0bc","created":"2024-04-01T15:21:33.437282+0000","modified":"2024-04-01T15:22:39.720405+0000","last_up_change":"2024-04-01T15:21:45.830997+0000","last_in_change":"2024-04-01T15:21:36.909239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T15:21:46.589606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T15:21:55.889957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T15:21:56.928636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4817062b-00fa-4b9f-814b-9cb2f2c43545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6809","nonce":3934118532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6811","nonce":3934118532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6815","nonce":3934118532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3934118532},{"type":"v1","addr":"172.21.15.142:6813","nonce":3934118532}]},"public_addr":"172.21.15.142:6809/3934118532","cluster_addr":"172.21.15.142:6811/3934118532","heartbeat_back_addr":"172.21.15.142:6815/3934118532","heartbeat_front_addr":"172.21.15.142:6813/3934118532","state":["exists","up"]},{"osd":1,"uuid":"d77f5b2b-2284-4192-a3e8-f3c45d65472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6823","nonce":2553070769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6827","nonce":2553070769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6831","nonce":2553070769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2553070769},{"type":"v1","addr":"172.21.15.142:6829","nonce":2553070769}]},"public_addr":"172.21.15.142:6823/2553070769","cluster_addr":"172.21.15.142:6827/2553070769","heartbeat_back_addr":"172.21.15.142:6831/2553070769","heartbeat_front_addr":"172.21.15.142:6829/2553070769","state":["exists","up"]},{"osd":2,"uuid":"913404ba-9757-4c51-9011-d79f9a575b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6817","nonce":894905692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6819","nonce":894905692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6826","nonce":894905692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":894905692},{"type":"v1","addr":"172.21.15.142:6822","nonce":894905692}]},"public_addr":"172.21.15.142:6817/894905692","cluster_addr":"172.21.15.142:6819/894905692","heartbeat_back_addr":"172.21.15.142:6826/894905692","heartbeat_front_addr":"172.21.15.142:6822/894905692","state":["exists","up"]},{"osd":3,"uuid":"dc946de0-8ebd-4054-a17b-7386b3255d4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6801","nonce":208376799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6803","nonce":208376799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6807","nonce":208376799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":208376799},{"type":"v1","addr":"172.21.15.142:6805","nonce":208376799}]},"public_addr":"172.21.15.142:6801/208376799","cluster_addr":"172.21.15.142:6803/208376799","heartbeat_back_addr":"172.21.15.142:6807/208376799","heartbeat_front_addr":"172.21.15.142:6805/208376799","state":["exists","up"]},{"osd":4,"uuid":"da0f028c-23d3-4483-96a4-89c230c68896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6818","nonce":934337813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6822","nonce":934337813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6829","nonce":934337813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":934337813},{"type":"v1","addr":"172.21.15.179:6826","nonce":934337813}]},"public_addr":"172.21.15.179:6818/934337813","cluster_addr":"172.21.15.179:6822/934337813","heartbeat_back_addr":"172.21.15.179:6829/934337813","heartbeat_front_addr":"172.21.15.179:6826/934337813","state":["exists","up"]},{"osd":5,"uuid":"dc20a6cd-0fa6-482d-9fe6-5390a1ffe307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6819","nonce":1223314628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6823","nonce":1223314628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6831","nonce":1223314628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":1223314628},{"type":"v1","addr":"172.21.15.179:6828","nonce":1223314628}]},"public_addr":"172.21.15.179:6819/1223314628","cluster_addr":"172.21.15.179:6823/1223314628","heartbeat_back_addr":"172.21.15.179:6831/1223314628","heartbeat_front_addr":"172.21.15.179:6828/1223314628","state":["exists","up"]},{"osd":6,"uuid":"cab4c5ef-8a70-4acb-b9d8-60f0078cab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6801","nonce":1199445012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6803","nonce":1199445012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6808","nonce":1199445012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1199445012},{"type":"v1","addr":"172.21.15.179:6805","nonce":1199445012}]},"public_addr":"172.21.15.179:6801/1199445012","cluster_addr":"172.21.15.179:6803/1199445012","heartbeat_back_addr":"172.21.15.179:6808/1199445012","heartbeat_front_addr":"172.21.15.179:6805/1199445012","state":["exists","up"]},{"osd":7,"uuid":"e48039cc-eccf-4f81-8ad6-908308758427","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6809","nonce":3234577124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6811","nonce":3234577124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6815","nonce":3234577124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3234577124},{"type":"v1","addr":"172.21.15.179:6813","nonce":3234577124}]},"public_addr":"172.21.15.179:6809/3234577124","cluster_addr":"172.21.15.179:6811/3234577124","heartbeat_back_addr":"172.21.15.179:6815/3234577124","heartbeat_front_addr":"172.21.15.179:6813/3234577124","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.510208+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.252570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.558516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.148466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.232389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.019055+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.240883+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T15:21:42.245360+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T15:24:39.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4f2006c920 msgr2=0x7f4f2006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4f2006c920 0x7f4f2006ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4f34036000 tx=0x7f4f3403b040 comp rx=0 tx=0).stop 2024-04-01T15:24:39.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f440b0290 msgr2=0x7f4f441deb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f440b0290 0x7f4f441deb10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00e9e0 tx=0x7f4f2c00eea0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 shutdown_connections 2024-04-01T15:24:39.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f4f2006c920 0x7f4f2006ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f44147be0 0x7f4f44146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f440b0290 0x7f4f441deb10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 --2- 172.21.15.142:0/2259280036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f4406d8d0 0x7f4f4413a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 >> 172.21.15.142:0/2259280036 conn(0x7f4f440b5890 msgr2=0x7f4f4406cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:39.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 shutdown_connections 2024-04-01T15:24:39.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.226+0000 7f4f4b000640 1 -- 172.21.15.142:0/2259280036 wait complete. 2024-04-01T15:24:39.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-01T15:24:39.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.451+0000 7f668d000640 1 Processor -- start 2024-04-01T15:24:39.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.451+0000 7f668d000640 1 -- start start 2024-04-01T15:24:39.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.451+0000 7f668d000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f66880b5be0 0x7f66880b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.451+0000 7f668d000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f668809eef0 con 0x7f66880b13a0 2024-04-01T15:24:39.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.451+0000 7f668d000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66880b5fc0 con 0x7f66880b0f10 2024-04-01T15:24:39.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.451+0000 7f668d000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f66880b08d0 con 0x7f66880b5be0 2024-04-01T15:24:39.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.452+0000 7f6687e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f66880b13a0 0x7f668814fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35742/0 (socket says 172.21.15.142:35742) 2024-04-01T15:24:39.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.452+0000 7f6687e00640 1 -- 172.21.15.142:0/3549402000 learned_addr learned my addr 172.21.15.142:0/3549402000 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:24:39.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.452+0000 7f6687400640 1 --2- 172.21.15.142:0/3549402000 >> v2:172.21.15.142:3300/0 conn(0x7f66880b5be0 0x7f66880b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.452+0000 7f6686000640 1 -- 172.21.15.142:0/3549402000 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735456617 0 0) 0x7f668809eef0 con 0x7f66880b13a0 2024-04-01T15:24:39.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.452+0000 7f6686000640 1 -- 172.21.15.142:0/3549402000 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f666c003520 con 0x7f66880b13a0 2024-04-01T15:24:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.452+0000 7f6687400640 1 -- 172.21.15.142:0/3549402000 >> v1:172.21.15.179:6789/0 conn(0x7f66880b0f10 legacy=0x7f6688072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.452+0000 7f6687400640 1 -- 172.21.15.142:0/3549402000 >> v1:172.21.15.142:6789/0 conn(0x7f66880b13a0 legacy=0x7f668814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.452+0000 7f6687400640 1 -- 172.21.15.142:0/3549402000 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66880b0b20 con 0x7f66880b5be0 2024-04-01T15:24:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.453+0000 7f6687400640 1 --2- 172.21.15.142:0/3549402000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b5be0 0x7f66880b4bd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f66880b0a50 tx=0x7f667802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bec242e68cc853 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f6686000640 1 -- 172.21.15.142:0/3549402000 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678035020 con 0x7f66880b5be0 2024-04-01T15:24:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f6686000640 1 -- 172.21.15.142:0/3549402000 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6678031810 con 0x7f66880b5be0 2024-04-01T15:24:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f6686000640 1 -- 172.21.15.142:0/3549402000 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678031bc0 con 0x7f66880b5be0 2024-04-01T15:24:39.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f668d000640 1 -- 172.21.15.142:0/3549402000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b5be0 msgr2=0x7f66880b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f668d000640 1 --2- 172.21.15.142:0/3549402000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b5be0 0x7f66880b4bd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f66880b0a50 tx=0x7f667802b8b0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f668d000640 1 -- 172.21.15.142:0/3549402000 shutdown_connections 2024-04-01T15:24:39.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f668d000640 1 --2- 172.21.15.142:0/3549402000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b5be0 0x7f66880b4bd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f668d000640 1 -- 172.21.15.142:0/3549402000 >> 172.21.15.142:0/3549402000 conn(0x7f668806c710 msgr2=0x7f668806cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:39.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f668d000640 1 -- 172.21.15.142:0/3549402000 shutdown_connections 2024-04-01T15:24:39.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.454+0000 7f668d000640 1 -- 172.21.15.142:0/3549402000 wait complete. 2024-04-01T15:24:39.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.456+0000 7f668d000640 1 Processor -- start 2024-04-01T15:24:39.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.456+0000 7f668d000640 1 -- start start 2024-04-01T15:24:39.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f668d000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b0f10 0x7f6688072220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f668d000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66880b13a0 0x7f6688142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f668d000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66880b5be0 0x7f668813e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f668d000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f66880b0190 con 0x7f66880b0f10 2024-04-01T15:24:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f668d000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f66880b2e40 con 0x7f66880b13a0 2024-04-01T15:24:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f668d000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f66880b0310 con 0x7f66880b5be0 2024-04-01T15:24:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f6687400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b0f10 0x7f6688072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f6687400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b0f10 0x7f6688072220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59092/0 (socket says 172.21.15.142:59092) 2024-04-01T15:24:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f6687400640 1 -- 172.21.15.142:0/1642508781 learned_addr learned my addr 172.21.15.142:0/1642508781 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f6687400640 1 -- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66880b5be0 msgr2=0x7f668813e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f6687400640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66880b5be0 0x7f668813e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f6687400640 1 -- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66880b13a0 msgr2=0x7f6688142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f6687400640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66880b13a0 0x7f6688142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.457+0000 7f6687400640 1 -- 172.21.15.142:0/1642508781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6688141fd0 con 0x7f66880b0f10 2024-04-01T15:24:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.458+0000 7f6687400640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b0f10 0x7f6688072220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f66780097a0 tx=0x7f66780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.458+0000 7f667f400640 1 -- 172.21.15.142:0/1642508781 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678041070 con 0x7f66880b0f10 2024-04-01T15:24:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.458+0000 7f667f400640 1 -- 172.21.15.142:0/1642508781 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f667803ad00 con 0x7f66880b0f10 2024-04-01T15:24:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.458+0000 7f667f400640 1 -- 172.21.15.142:0/1642508781 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678035040 con 0x7f66880b0f10 2024-04-01T15:24:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.458+0000 7f668d000640 1 -- 172.21.15.142:0/1642508781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66881408d0 con 0x7f66880b0f10 2024-04-01T15:24:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.458+0000 7f668d000640 1 -- 172.21.15.142:0/1642508781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66881410b0 con 0x7f66880b0f10 2024-04-01T15:24:39.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.459+0000 7f667cc00640 1 -- 172.21.15.142:0/1642508781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6688068590 con 0x7f66880b0f10 2024-04-01T15:24:39.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.460+0000 7f667f400640 1 -- 172.21.15.142:0/1642508781 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6678038020 con 0x7f66880b0f10 2024-04-01T15:24:39.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.461+0000 7f667f400640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f666806c8f0 0x7f666806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.461+0000 7f667f400640 1 -- 172.21.15.142:0/1642508781 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f66780ad9a0 con 0x7f66880b0f10 2024-04-01T15:24:39.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.461+0000 7f6686a00640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f666806c8f0 0x7f666806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.462+0000 7f6686a00640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f666806c8f0 0x7f666806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6674000fb0 tx=0x7f66740079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:39.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.466+0000 7f667f400640 1 -- 172.21.15.142:0/1642508781 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f667807bcb0 con 0x7f66880b0f10 2024-04-01T15:24:39.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.684+0000 7f667cc00640 1 -- 172.21.15.142:0/1642508781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6688140cd0 con 0x7f66880b0f10 2024-04-01T15:24:39.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.688+0000 7f667f400640 1 -- 172.21.15.142:0/1642508781 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f6678043e10 con 0x7f66880b0f10 2024-04-01T15:24:39.690 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-01T15:24:39.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.691+0000 7f667cc00640 1 -- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f666806c8f0 msgr2=0x7f666806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.691+0000 7f667cc00640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f666806c8f0 0x7f666806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6674000fb0 tx=0x7f66740079c0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.691+0000 7f667cc00640 1 -- 172.21.15.142:0/1642508781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b0f10 msgr2=0x7f6688072220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.691+0000 7f667cc00640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b0f10 0x7f6688072220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f66780097a0 tx=0x7f66780046c0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.692+0000 7f667cc00640 1 -- 172.21.15.142:0/1642508781 shutdown_connections 2024-04-01T15:24:39.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.692+0000 7f667cc00640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f666806c8f0 0x7f666806edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.692+0000 7f667cc00640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66880b5be0 0x7f668813e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.692+0000 7f667cc00640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66880b13a0 0x7f6688142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.692+0000 7f667cc00640 1 --2- 172.21.15.142:0/1642508781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66880b0f10 0x7f6688072220 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.692+0000 7f667cc00640 1 -- 172.21.15.142:0/1642508781 >> 172.21.15.142:0/1642508781 conn(0x7f668806c710 msgr2=0x7f6688143b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:39.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.692+0000 7f667cc00640 1 -- 172.21.15.142:0/1642508781 shutdown_connections 2024-04-01T15:24:39.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.692+0000 7f667cc00640 1 -- 172.21.15.142:0/1642508781 wait complete. 2024-04-01T15:24:39.710 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-01T15:24:39.727 INFO:tasks.ceph.mds.b.smithi179.stderr: -8981> 2024-04-01T15:22:03.936+0000 7f4332e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-01T15:24:39.814 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-04-01T15:24:39.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.913+0000 7ff5b8a00640 1 Processor -- start 2024-04-01T15:24:39.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.914+0000 7ff5b8a00640 1 -- start start 2024-04-01T15:24:39.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5b8a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b406d740 0x7ff5b40b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5b8a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5b40b0ef0 0x7ff5b41459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5b8a00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5b40b1350 0x7ff5b4145f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5b8a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b40b2ed0 con 0x7ff5b40b0ef0 2024-04-01T15:24:39.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5b8a00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b406db20 con 0x7ff5b40b1350 2024-04-01T15:24:39.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5b8a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b40b08d0 con 0x7ff5b406d740 2024-04-01T15:24:39.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5a9e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5b40b0ef0 0x7ff5b41459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5a9e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5b40b0ef0 0x7ff5b41459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59102/0 (socket says 172.21.15.142:59102) 2024-04-01T15:24:39.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5a9e00640 1 -- 172.21.15.142:0/238830415 learned_addr learned my addr 172.21.15.142:0/238830415 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:39.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5b2800640 1 --2- 172.21.15.142:0/238830415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b406d740 0x7ff5b40b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.915+0000 7ff5b3200640 1 --2- 172.21.15.142:0/238830415 >> v2:172.21.15.179:3300/0 conn(0x7ff5b40b1350 0x7ff5b4145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.916+0000 7ff5a9e00640 1 -- 172.21.15.142:0/238830415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b406d740 msgr2=0x7ff5b40b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:39.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.916+0000 7ff5a9e00640 1 --2- 172.21.15.142:0/238830415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b406d740 0x7ff5b40b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.916+0000 7ff5a9e00640 1 -- 172.21.15.142:0/238830415 >> v2:172.21.15.179:3300/0 conn(0x7ff5b40b1350 msgr2=0x7ff5b4145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:39.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.916+0000 7ff5a9e00640 1 --2- 172.21.15.142:0/238830415 >> v2:172.21.15.179:3300/0 conn(0x7ff5b40b1350 0x7ff5b4145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.916+0000 7ff5a9e00640 1 -- 172.21.15.142:0/238830415 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b40b0bb0 con 0x7ff5b40b0ef0 2024-04-01T15:24:39.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.917+0000 7ff5a9e00640 1 --2- 172.21.15.142:0/238830415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b0ef0 0x7ff5b41459d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40b0670 tx=0x7ff59c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda0904dfa44703f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:39.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.917+0000 7ff5b1e00640 1 -- 172.21.15.142:0/238830415 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c02e070 con 0x7ff5b40b0ef0 2024-04-01T15:24:39.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.917+0000 7ff5b1e00640 1 -- 172.21.15.142:0/238830415 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff59c037070 con 0x7ff5b40b0ef0 2024-04-01T15:24:39.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.917+0000 7ff5b1e00640 1 -- 172.21.15.142:0/238830415 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c031a20 con 0x7ff5b40b0ef0 2024-04-01T15:24:39.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.918+0000 7ff5b8a00640 1 -- 172.21.15.142:0/238830415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b0ef0 msgr2=0x7ff5b41459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.918+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/238830415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b0ef0 0x7ff5b41459d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40b0670 tx=0x7ff59c02b880 comp rx=0 tx=0).stop 2024-04-01T15:24:39.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.918+0000 7ff5b8a00640 1 -- 172.21.15.142:0/238830415 shutdown_connections 2024-04-01T15:24:39.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.918+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/238830415 >> v2:172.21.15.179:3300/0 conn(0x7ff5b40b1350 0x7ff5b4145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.918+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/238830415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b0ef0 0x7ff5b41459d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.918+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/238830415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b406d740 0x7ff5b40b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.918+0000 7ff5b8a00640 1 -- 172.21.15.142:0/238830415 >> 172.21.15.142:0/238830415 conn(0x7ff5b40b5790 msgr2=0x7ff5b40b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:39.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.918+0000 7ff5b8a00640 1 -- 172.21.15.142:0/238830415 shutdown_connections 2024-04-01T15:24:39.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.918+0000 7ff5b8a00640 1 -- 172.21.15.142:0/238830415 wait complete. 2024-04-01T15:24:39.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.919+0000 7ff5b8a00640 1 Processor -- start 2024-04-01T15:24:39.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.919+0000 7ff5b8a00640 1 -- start start 2024-04-01T15:24:39.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.920+0000 7ff5b8a00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b406d740 0x7ff5b4071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.920+0000 7ff5b8a00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40b0ef0 0x7ff5b413d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.920+0000 7ff5b8a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b1350 0x7ff5b413dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.920+0000 7ff5b8a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b40b0310 con 0x7ff5b40b1350 2024-04-01T15:24:39.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.920+0000 7ff5b8a00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b40b0190 con 0x7ff5b406d740 2024-04-01T15:24:39.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.920+0000 7ff5b8a00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b4145300 con 0x7ff5b40b0ef0 2024-04-01T15:24:39.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.920+0000 7ff5b3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b1350 0x7ff5b413dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b1350 0x7ff5b413dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59118/0 (socket says 172.21.15.142:59118) 2024-04-01T15:24:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b3200640 1 -- 172.21.15.142:0/1832188626 learned_addr learned my addr 172.21.15.142:0/1832188626 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b2800640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b406d740 0x7ff5b4071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5a9e00640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40b0ef0 0x7ff5b413d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b3200640 1 -- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40b0ef0 msgr2=0x7ff5b413d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b3200640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40b0ef0 0x7ff5b413d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b3200640 1 -- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b406d740 msgr2=0x7ff5b4071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b3200640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b406d740 0x7ff5b4071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b3200640 1 -- 172.21.15.142:0/1832188626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b40aea90 con 0x7ff5b40b1350 2024-04-01T15:24:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b2800640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b406d740 0x7ff5b4071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T15:24:39.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5b3200640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b1350 0x7ff5b413dbb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007e60 tx=0x7ff5ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:39.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5ab400640 1 -- 172.21.15.142:0/1832188626 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac014420 con 0x7ff5b40b1350 2024-04-01T15:24:39.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5ab400640 1 -- 172.21.15.142:0/1832188626 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff5ac019070 con 0x7ff5b40b1350 2024-04-01T15:24:39.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.921+0000 7ff5ab400640 1 -- 172.21.15.142:0/1832188626 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac014840 con 0x7ff5b40b1350 2024-04-01T15:24:39.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.922+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b40710f0 con 0x7ff5b40b1350 2024-04-01T15:24:39.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.922+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b4071e80 con 0x7ff5b40b1350 2024-04-01T15:24:39.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.923+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b4068590 con 0x7ff5b40b1350 2024-04-01T15:24:39.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.924+0000 7ff5ab400640 1 -- 172.21.15.142:0/1832188626 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5ac0149e0 con 0x7ff5b40b1350 2024-04-01T15:24:39.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.925+0000 7ff5ab400640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff59006c8f0 0x7ff59006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:39.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.925+0000 7ff5ab400640 1 -- 172.21.15.142:0/1832188626 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7ff5ac08c4e0 con 0x7ff5b40b1350 2024-04-01T15:24:39.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.925+0000 7ff5b2800640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff59006c8f0 0x7ff59006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:39.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.926+0000 7ff5b2800640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff59006c8f0 0x7ff59006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4006fd0 tx=0x7ff5a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:39.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:39.930+0000 7ff5ab400640 1 -- 172.21.15.142:0/1832188626 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff5ac05a7a0 con 0x7ff5b40b1350 2024-04-01T15:24:40.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.153+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff5b4143310 con 0x7ff5b40b1350 2024-04-01T15:24:40.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.693+0000 7ff5ab400640 1 -- 172.21.15.142:0/1832188626 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7ff5ac05a0a0 con 0x7ff5b40b1350 2024-04-01T15:24:40.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff59006c8f0 msgr2=0x7ff59006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:40.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff59006c8f0 0x7ff59006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4006fd0 tx=0x7ff5a4008040 comp rx=0 tx=0).stop 2024-04-01T15:24:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b1350 msgr2=0x7ff5b413dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b1350 0x7ff5b413dbb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007e60 tx=0x7ff5ac00e4b0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 shutdown_connections 2024-04-01T15:24:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7ff59006c8f0 0x7ff59006edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5b40b1350 0x7ff5b413dbb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40b0ef0 0x7ff5b413d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 --2- 172.21.15.142:0/1832188626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b406d740 0x7ff5b4071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 >> 172.21.15.142:0/1832188626 conn(0x7ff5b40b5790 msgr2=0x7ff5b4143e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:40.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 shutdown_connections 2024-04-01T15:24:40.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.697+0000 7ff5b8a00640 1 -- 172.21.15.142:0/1832188626 wait complete. 2024-04-01T15:24:40.717 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-01T15:24:40.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.929+0000 7f7fd7200640 1 Processor -- start 2024-04-01T15:24:40.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.929+0000 7f7fd7200640 1 -- start start 2024-04-01T15:24:40.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.930+0000 7f7fd7200640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7fd814ec20 0x7f7fd8151010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:40.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.930+0000 7f7fd7200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd80b1600 con 0x7f7fd80b4bb0 2024-04-01T15:24:40.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.930+0000 7f7fd7200640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd806db20 con 0x7f7fd806d740 2024-04-01T15:24:40.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.930+0000 7f7fd7200640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd80b2ed0 con 0x7f7fd814ec20 2024-04-01T15:24:40.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.931+0000 7f7fcfe00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7fd80b4bb0 0x7f7fd81459d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35748/0 (socket says 172.21.15.142:35748) 2024-04-01T15:24:40.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.931+0000 7f7fcfe00640 1 -- 172.21.15.142:0/814165078 learned_addr learned my addr 172.21.15.142:0/814165078 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-01T15:24:40.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.931+0000 7f7fd6800640 1 --2- 172.21.15.142:0/814165078 >> v2:172.21.15.179:3300/0 conn(0x7f7fd814ec20 0x7f7fd8151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:40.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.931+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183550760 0 0) 0x7f7fc0001110 con 0x7f7fd80b4bb0 2024-04-01T15:24:40.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.931+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fbc003520 con 0x7f7fd80b4bb0 2024-04-01T15:24:40.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1095773240 0 0) 0x7f7fbc003520 con 0x7f7fd80b4bb0 2024-04-01T15:24:40.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 >> v2:172.21.15.179:3300/0 conn(0x7f7fd814ec20 msgr2=0x7f7fd8151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:40.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 --2- 172.21.15.142:0/814165078 >> v2:172.21.15.179:3300/0 conn(0x7f7fd814ec20 0x7f7fd8151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 >> v1:172.21.15.179:6789/0 conn(0x7f7fd806d740 legacy=0x7f7fd80b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:40.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd80b08d0 con 0x7f7fd80b4bb0 2024-04-01T15:24:40.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 706452284 0 0) 0x7f7fc0001840 con 0x7f7fd80b4bb0 2024-04-01T15:24:40.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 >> v1:172.21.15.142:6789/0 conn(0x7f7fd80b4bb0 legacy=0x7f7fd81459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fbc004800 0x7f7fbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fbc0051c0 0x7f7fbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc00c130 con 0x7f7fbc0039b0 2024-04-01T15:24:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc00c2e0 con 0x7f7fbc004800 2024-04-01T15:24:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc00c4e0 con 0x7f7fbc0051c0 2024-04-01T15:24:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5e00640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fcfe00640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fbc004800 0x7f7fbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5e00640 1 -- 172.21.15.142:0/814165078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fbc0051c0 msgr2=0x7f7fbc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:40.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5e00640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fbc0051c0 0x7f7fbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5e00640 1 -- 172.21.15.142:0/814165078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fbc004800 msgr2=0x7f7fbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:40.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5e00640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fbc004800 0x7f7fbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd5e00640 1 -- 172.21.15.142:0/814165078 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc003520 con 0x7f7fbc0039b0 2024-04-01T15:24:40.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fcfe00640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fbc004800 0x7f7fbc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:24:40.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.932+0000 7f7fd6800640 1 -- 172.21.15.142:0/814165078 reap_dead start 2024-04-01T15:24:40.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.933+0000 7f7fd5e00640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fbc003dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8001750 tx=0x7f7fbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3900326813da87d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:40.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.934+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8001370 con 0x7f7fbc0039b0 2024-04-01T15:24:40.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.934+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7fc80052d0 con 0x7f7fbc0039b0 2024-04-01T15:24:40.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.934+0000 7f7fd5400640 1 -- 172.21.15.142:0/814165078 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8003850 con 0x7f7fbc0039b0 2024-04-01T15:24:40.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.934+0000 7f7fd7200640 1 -- 172.21.15.142:0/814165078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 msgr2=0x7f7fbc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:40.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.934+0000 7f7fd7200640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fbc003dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8001750 tx=0x7f7fbc005830 comp rx=0 tx=0).stop 2024-04-01T15:24:40.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.934+0000 7f7fd7200640 1 -- 172.21.15.142:0/814165078 shutdown_connections 2024-04-01T15:24:40.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.934+0000 7f7fd7200640 1 --2- 172.21.15.142:0/814165078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fbc003dd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.934+0000 7f7fd7200640 1 -- 172.21.15.142:0/814165078 >> 172.21.15.142:0/814165078 conn(0x7f7fd80b5790 msgr2=0x7f7fd80b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:40.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.934+0000 7f7fd7200640 1 -- 172.21.15.142:0/814165078 shutdown_connections 2024-04-01T15:24:40.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.935+0000 7f7fd7200640 1 -- 172.21.15.142:0/814165078 wait complete. 2024-04-01T15:24:40.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.936+0000 7f7fd7200640 1 Processor -- start 2024-04-01T15:24:40.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.936+0000 7f7fd7200640 1 -- start start 2024-04-01T15:24:40.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.937+0000 7f7fd7200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fd81422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:40.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.937+0000 7f7fd7200640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fd809d800 0x7f7fd809b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:40.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.937+0000 7f7fd7200640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fd813be70 0x7f7fd813c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:40.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.937+0000 7f7fd7200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80b0190 con 0x7f7fbc0039b0 2024-04-01T15:24:40.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.937+0000 7f7fd7200640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80b2ad0 con 0x7f7fd809d800 2024-04-01T15:24:40.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.937+0000 7f7fd7200640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd80b0310 con 0x7f7fd813be70 2024-04-01T15:24:40.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.937+0000 7f7fd5e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fd81422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:40.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.937+0000 7f7fd5e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fd81422e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59142/0 (socket says 172.21.15.142:59142) 2024-04-01T15:24:40.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.937+0000 7f7fd5e00640 1 -- 172.21.15.142:0/1226049354 learned_addr learned my addr 172.21.15.142:0/1226049354 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:40.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fcfe00640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fd809d800 0x7f7fd809b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:40.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fd5e00640 1 -- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fd813be70 msgr2=0x7f7fd813c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:40.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fd6800640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fd813be70 0x7f7fd813c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:40.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fd5e00640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fd813be70 0x7f7fd813c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fd5e00640 1 -- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fd809d800 msgr2=0x7f7fd809b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:40.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fd5e00640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fd809d800 0x7f7fd809b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:40.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fd5e00640 1 -- 172.21.15.142:0/1226049354 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd809b5c0 con 0x7f7fbc0039b0 2024-04-01T15:24:40.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fcfe00640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fd809d800 0x7f7fd809b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T15:24:40.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fd5e00640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fd81422e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8005040 tx=0x7f7fc8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:40.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fce000640 1 -- 172.21.15.142:0/1226049354 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8041020 con 0x7f7fbc0039b0 2024-04-01T15:24:40.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fce000640 1 -- 172.21.15.142:0/1226049354 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7fc8005480 con 0x7f7fbc0039b0 2024-04-01T15:24:40.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd809ca40 con 0x7f7fbc0039b0 2024-04-01T15:24:40.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fce000640 1 -- 172.21.15.142:0/1226049354 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8007a30 con 0x7f7fbc0039b0 2024-04-01T15:24:40.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.938+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd809c760 con 0x7f7fbc0039b0 2024-04-01T15:24:40.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.940+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd8068590 con 0x7f7fbc0039b0 2024-04-01T15:24:40.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.941+0000 7f7fce000640 1 -- 172.21.15.142:0/1226049354 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fc8044020 con 0x7f7fbc0039b0 2024-04-01T15:24:40.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.942+0000 7f7fce000640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7fb406c8f0 0x7f7fb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:40.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.942+0000 7f7fce000640 1 -- 172.21.15.142:0/1226049354 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f7fc80ad710 con 0x7f7fbc0039b0 2024-04-01T15:24:40.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.942+0000 7f7fcfe00640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7fb406c8f0 0x7f7fb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:40.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.943+0000 7f7fcfe00640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7fb406c8f0 0x7f7fb406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00012b0 tx=0x7f7fc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:40.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:40.946+0000 7f7fce000640 1 -- 172.21.15.142:0/1226049354 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7fc804b030 con 0x7f7fbc0039b0 2024-04-01T15:24:41.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.145+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7fd8141720 con 0x7f7fbc0039b0 2024-04-01T15:24:41.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.697+0000 7f7fce000640 1 -- 172.21.15.142:0/1226049354 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f7fc807b9e0 con 0x7f7fbc0039b0 2024-04-01T15:24:41.697 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2024-04-01T15:24:41.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.700+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7fb406c8f0 msgr2=0x7f7fb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:41.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.700+0000 7f7fd7200640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7fb406c8f0 0x7f7fb406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00012b0 tx=0x7f7fc0009040 comp rx=0 tx=0).stop 2024-04-01T15:24:41.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.700+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 msgr2=0x7f7fd81422e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:41.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.700+0000 7f7fd7200640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fd81422e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8005040 tx=0x7f7fc8001120 comp rx=0 tx=0).stop 2024-04-01T15:24:41.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.701+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 shutdown_connections 2024-04-01T15:24:41.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.701+0000 7f7fd7200640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f7fb406c8f0 0x7f7fb406edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:41.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.701+0000 7f7fd7200640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fd813be70 0x7f7fd813c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:41.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.701+0000 7f7fd7200640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fd809d800 0x7f7fd809b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:41.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.701+0000 7f7fd7200640 1 --2- 172.21.15.142:0/1226049354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc0039b0 0x7f7fd81422e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:41.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.701+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 >> 172.21.15.142:0/1226049354 conn(0x7f7fd80b5790 msgr2=0x7f7fd8144270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:41.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.701+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 shutdown_connections 2024-04-01T15:24:41.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.701+0000 7f7fd7200640 1 -- 172.21.15.142:0/1226049354 wait complete. 2024-04-01T15:24:41.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-01T15:24:41.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.919+0000 7f7534000640 1 Processor -- start 2024-04-01T15:24:41.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.919+0000 7f7534000640 1 -- start start 2024-04-01T15:24:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7534000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c0afae0 0x7f752c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7534000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f752c14ae90 0x7f752c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7534000640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f752c0b55a0 con 0x7f752c0b51c0 2024-04-01T15:24:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7534000640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f752c0b0430 con 0x7f752c14ae90 2024-04-01T15:24:41.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7534000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f752c0ae8c0 con 0x7f752c0afae0 2024-04-01T15:24:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7530c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c0afae0 0x7f752c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7532000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f752c14ae90 0x7f752c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:41.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7530c00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c0afae0 0x7f752c0b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.142:57820/0 (socket says 172.21.15.142:57820) 2024-04-01T15:24:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7532000640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f752c14ae90 0x7f752c0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.142:50720/0 (socket says 172.21.15.142:50720) 2024-04-01T15:24:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.921+0000 7f7530c00640 1 -- 172.21.15.142:0/895096964 learned_addr learned my addr 172.21.15.142:0/895096964 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.922+0000 7f7532000640 1 -- 172.21.15.142:0/895096964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c0afae0 msgr2=0x7f752c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T15:24:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.922+0000 7f7532000640 1 --2- 172.21.15.142:0/895096964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c0afae0 0x7f752c0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.922+0000 7f7532000640 1 -- 172.21.15.142:0/895096964 >> v1:172.21.15.179:6789/0 conn(0x7f752c0b51c0 legacy=0x7f752c0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.922+0000 7f7532000640 1 -- 172.21.15.142:0/895096964 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c06db20 con 0x7f752c14ae90 2024-04-01T15:24:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.922+0000 7f7530c00640 1 --2- 172.21.15.142:0/895096964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c0afae0 0x7f752c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T15:24:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.923+0000 7f7532000640 1 --2- 172.21.15.142:0/895096964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f752c14ae90 0x7f752c0aede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7524009d90 tx=0x7f752402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c46bc499ee0069 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.924+0000 7f752be00640 1 -- 172.21.15.142:0/895096964 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524039070 con 0x7f752c14ae90 2024-04-01T15:24:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.924+0000 7f752be00640 1 -- 172.21.15.142:0/895096964 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f752402cb30 con 0x7f752c14ae90 2024-04-01T15:24:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.924+0000 7f752be00640 1 -- 172.21.15.142:0/895096964 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524034440 con 0x7f752c14ae90 2024-04-01T15:24:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.924+0000 7f7534000640 1 -- 172.21.15.142:0/895096964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f752c14ae90 msgr2=0x7f752c0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.924+0000 7f7534000640 1 --2- 172.21.15.142:0/895096964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f752c14ae90 0x7f752c0aede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7524009d90 tx=0x7f752402bd80 comp rx=0 tx=0).stop 2024-04-01T15:24:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.925+0000 7f7534000640 1 -- 172.21.15.142:0/895096964 shutdown_connections 2024-04-01T15:24:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.925+0000 7f7534000640 1 --2- 172.21.15.142:0/895096964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f752c14ae90 0x7f752c0aede0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.925+0000 7f7534000640 1 --2- 172.21.15.142:0/895096964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c0afae0 0x7f752c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.925+0000 7f7534000640 1 -- 172.21.15.142:0/895096964 >> 172.21.15.142:0/895096964 conn(0x7f752c0b5890 msgr2=0x7f752c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.925+0000 7f7534000640 1 -- 172.21.15.142:0/895096964 shutdown_connections 2024-04-01T15:24:41.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.925+0000 7f7534000640 1 -- 172.21.15.142:0/895096964 wait complete. 2024-04-01T15:24:41.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.926+0000 7f7534000640 1 Processor -- start 2024-04-01T15:24:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.926+0000 7f7534000640 1 -- start start 2024-04-01T15:24:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.927+0000 7f7534000640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f752c0b51c0 0x7f752c071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.927+0000 7f7534000640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c14ae90 0x7f752c142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.927+0000 7f7534000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c071f80 0x7f752c06fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.927+0000 7f7534000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f752c0ae2f0 con 0x7f752c071f80 2024-04-01T15:24:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.927+0000 7f7534000640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f752c0ae170 con 0x7f752c0b51c0 2024-04-01T15:24:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.927+0000 7f7534000640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f752c1521c0 con 0x7f752c14ae90 2024-04-01T15:24:41.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.927+0000 7f7532000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c071f80 0x7f752c06fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.927+0000 7f7532000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c071f80 0x7f752c06fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59154/0 (socket says 172.21.15.142:59154) 2024-04-01T15:24:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.927+0000 7f7532000640 1 -- 172.21.15.142:0/3317725290 learned_addr learned my addr 172.21.15.142:0/3317725290 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-01T15:24:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7531600640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f752c0b51c0 0x7f752c071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7530c00640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c14ae90 0x7f752c142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7532000640 1 -- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c14ae90 msgr2=0x7f752c142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7532000640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c14ae90 0x7f752c142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7532000640 1 -- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f752c0b51c0 msgr2=0x7f752c071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7532000640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f752c0b51c0 0x7f752c071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7532000640 1 -- 172.21.15.142:0/3317725290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c0724d0 con 0x7f752c071f80 2024-04-01T15:24:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7532000640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c071f80 0x7f752c06fb90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7524037040 tx=0x7f7524004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7529600640 1 -- 172.21.15.142:0/3317725290 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524039050 con 0x7f752c071f80 2024-04-01T15:24:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7529600640 1 -- 172.21.15.142:0/3317725290 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7524045070 con 0x7f752c071f80 2024-04-01T15:24:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.928+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752c0727b0 con 0x7f752c071f80 2024-04-01T15:24:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.929+0000 7f7529600640 1 -- 172.21.15.142:0/3317725290 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752403e870 con 0x7f752c071f80 2024-04-01T15:24:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.929+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f752c151c20 con 0x7f752c071f80 2024-04-01T15:24:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.930+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f752c0700d0 con 0x7f752c071f80 2024-04-01T15:24:41.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.931+0000 7f7529600640 1 -- 172.21.15.142:0/3317725290 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f752403ea10 con 0x7f752c071f80 2024-04-01T15:24:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.932+0000 7f7529600640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f750c06c8f0 0x7f750c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T15:24:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.932+0000 7f7529600640 1 -- 172.21.15.142:0/3317725290 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7f75240ae7c0 con 0x7f752c071f80 2024-04-01T15:24:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.932+0000 7f7531600640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f750c06c8f0 0x7f750c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T15:24:41.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.933+0000 7f7531600640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f750c06c8f0 0x7f750c06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7520007fd0 tx=0x7f7520009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T15:24:41.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:41.936+0000 7f7529600640 1 -- 172.21.15.142:0/3317725290 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f752c0700d0 con 0x7f752c071f80 2024-04-01T15:24:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.136+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f752c068710 con 0x7f752c071f80 2024-04-01T15:24:42.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.714+0000 7f7529600640 1 -- 172.21.15.142:0/3317725290 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f752407ccc0 con 0x7f752c071f80 2024-04-01T15:24:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2024-04-01T15:24:42.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f750c06c8f0 msgr2=0x7f750c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:42.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f750c06c8f0 0x7f750c06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7520007fd0 tx=0x7f7520009040 comp rx=0 tx=0).stop 2024-04-01T15:24:42.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c071f80 msgr2=0x7f752c06fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T15:24:42.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c071f80 0x7f752c06fb90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7524037040 tx=0x7f7524004a40 comp rx=0 tx=0).stop 2024-04-01T15:24:42.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 shutdown_connections 2024-04-01T15:24:42.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:6832/898130770,v1:172.21.15.179:6833/898130770] conn(0x7f750c06c8f0 0x7f750c06edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:42.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c071f80 0x7f752c06fb90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:42.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f752c14ae90 0x7f752c142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:42.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 --2- 172.21.15.142:0/3317725290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f752c0b51c0 0x7f752c071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T15:24:42.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 >> 172.21.15.142:0/3317725290 conn(0x7f752c0b5890 msgr2=0x7f752c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T15:24:42.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 shutdown_connections 2024-04-01T15:24:42.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-01T15:24:42.718+0000 7f7534000640 1 -- 172.21.15.142:0/3317725290 wait complete. 2024-04-01T15:24:42.743 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-01T15:24:42.743 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-01T15:24:42.744 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:42.765 INFO:tasks.ceph.mds.a:Stopped 2024-04-01T15:24:42.766 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-01T15:24:42.766 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:42.785 INFO:tasks.ceph.mds.b:Stopped 2024-04-01T15:24:42.785 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-01T15:24:42.785 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-01T15:24:42.785 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:42.875 INFO:tasks.ceph.osd.0:Stopped 2024-04-01T15:24:42.876 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-01T15:24:42.876 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:42.950 INFO:tasks.ceph.osd.1:Stopped 2024-04-01T15:24:42.951 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-01T15:24:42.951 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.024 INFO:tasks.ceph.osd.2:Stopped 2024-04-01T15:24:43.025 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-01T15:24:43.025 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.082 INFO:tasks.ceph.osd.3:Stopped 2024-04-01T15:24:43.082 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-01T15:24:43.082 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.153 INFO:tasks.ceph.osd.4:Stopped 2024-04-01T15:24:43.154 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-01T15:24:43.154 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.217 INFO:tasks.ceph.osd.5:Stopped 2024-04-01T15:24:43.218 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-01T15:24:43.218 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.283 INFO:tasks.ceph.osd.6:Stopped 2024-04-01T15:24:43.283 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-01T15:24:43.284 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.353 INFO:tasks.ceph.osd.7:Stopped 2024-04-01T15:24:43.354 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-01T15:24:43.354 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-01T15:24:43.354 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.429 INFO:tasks.ceph.mgr.y:Stopped 2024-04-01T15:24:43.430 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-01T15:24:43.430 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.513 INFO:tasks.ceph.mgr.x:Stopped 2024-04-01T15:24:43.513 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-01T15:24:43.514 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-01T15:24:43.514 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.562 INFO:tasks.ceph.mon.a:Stopped 2024-04-01T15:24:43.562 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-01T15:24:43.563 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.594 INFO:tasks.ceph.mon.b:Stopped 2024-04-01T15:24:43.595 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-01T15:24:43.595 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T15:24:43.669 INFO:tasks.ceph.mon.c:Stopped 2024-04-01T15:24:43.669 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-01T15:24:43.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-01T15:24:43.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:24:43.782 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-01T15:24:44.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:24:44.069 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-01T15:24:44.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:24:44.236 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-01T15:24:44.372 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:24:44.372 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-01T15:24:44.512 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:24:44.512 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-01T15:24:44.765 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:24:44.765 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-01T15:24:44.916 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:24:44.916 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-01T15:24:45.057 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:24:45.058 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-01T15:24:45.226 INFO:tasks.ceph:Archiving mon data... 2024-04-01T15:24:45.227 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/data/mon.a.tgz 2024-04-01T15:24:45.227 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-01T15:24:45.285 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.Ypc8ZHsTzw 2024-04-01T15:24:45.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Ypc8ZHsTzw 2024-04-01T15:24:45.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.Ypc8ZHsTzw 2024-04-01T15:24:45.599 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.Ypc8ZHsTzw is 261KB 2024-04-01T15:24:45.704 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.Ypc8ZHsTzw 2024-04-01T15:24:45.759 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/data/mon.b.tgz 2024-04-01T15:24:45.759 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-04-01T15:24:45.815 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.LfYrUS7L1m 2024-04-01T15:24:45.815 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LfYrUS7L1m 2024-04-01T15:24:46.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.LfYrUS7L1m 2024-04-01T15:24:46.158 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.LfYrUS7L1m is 357KB 2024-04-01T15:24:46.263 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.LfYrUS7L1m 2024-04-01T15:24:46.318 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/data/mon.c.tgz 2024-04-01T15:24:46.318 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-04-01T15:24:46.368 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.YE3ybqhiGD 2024-04-01T15:24:46.368 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YE3ybqhiGD 2024-04-01T15:24:46.537 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.YE3ybqhiGD 2024-04-01T15:24:46.675 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.YE3ybqhiGD is 358KB 2024-04-01T15:24:46.780 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.YE3ybqhiGD 2024-04-01T15:24:46.835 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-01T15:24:46.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T15:24:46.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T15:24:46.987 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-01T15:24:47.042 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-01T15:24:47.042 INFO:tasks.ceph:Archiving crash dumps... 2024-04-01T15:24:47.044 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/remote/smithi142/crash 2024-04-01T15:24:47.044 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T15:24:47.135 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/remote/smithi179/crash 2024-04-01T15:24:47.136 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T15:24:47.231 INFO:tasks.ceph:Shutting down logrotate 2024-04-01T15:24:47.231 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:24:47.238 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T15:24:47.363 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T15:24:47.454 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T15:24:47.539 INFO:tasks.ceph:Compressing logs... 2024-04-01T15:24:47.539 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T15:24:47.546 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T15:24:47.632 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-01T15:24:47.632 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-01T15:24:47.633 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36624.log 2024-04-01T15:24:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46158.log 2024-04-01T15:24:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44740.log 2024-04-01T15:24:47.635 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T15:24:47.635 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36624.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-01T15:24:47.635 INFO:teuthology.orchestra.run.smithi179.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36624.log.gz 2024-04-01T15:24:47.636 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-01T15:24:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44119.log 2024-04-01T15:24:47.637 INFO:teuthology.orchestra.run.smithi142.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46158.log.gz 2024-04-01T15:24:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43144.log 2024-04-01T15:24:47.638 INFO:teuthology.orchestra.run.smithi142.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44740.log.gz 2024-04-01T15:24:47.638 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45762.log 2024-04-01T15:24:47.638 INFO:teuthology.orchestra.run.smithi142.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44119.log.gz 2024-04-01T15:24:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37057.log 2024-04-01T15:24:47.640 INFO:teuthology.orchestra.run.smithi142.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43144.log.gz 2024-04-01T15:24:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42720.log 2024-04-01T15:24:47.640 INFO:teuthology.orchestra.run.smithi142.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45762.log.gz 2024-04-01T15:24:47.641 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36584.log 2024-04-01T15:24:47.641 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T15:24:47.641 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36704.log 2024-04-01T15:24:47.641 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36584.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36584.log.gz 2024-04-01T15:24:47.641 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-01T15:24:47.643 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-01T15:24:47.643 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36704.log: /var/log/ceph/ceph-osd.7.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36704.log.gz 2024-04-01T15:24:47.643 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36664.log 2024-04-01T15:24:47.644 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45594.log 2024-04-01T15:24:47.644 INFO:teuthology.orchestra.run.smithi142.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37057.log.gz 2024-04-01T15:24:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42720.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42720.log.gz 2024-04-01T15:24:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43494.log 2024-04-01T15:24:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45948.log 2024-04-01T15:24:47.645 INFO:teuthology.orchestra.run.smithi142.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45594.log.gz 2024-04-01T15:24:47.645 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44164.log 2024-04-01T15:24:47.645 INFO:teuthology.orchestra.run.smithi142.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43494.log.gz 2024-04-01T15:24:47.648 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36864.log 2024-04-01T15:24:47.648 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36664.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-01T15:24:47.649 INFO:teuthology.orchestra.run.smithi179.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36664.log.gz 2024-04-01T15:24:47.649 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36864.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36864.log.gz 2024-04-01T15:24:47.649 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36784.log 2024-04-01T15:24:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45990.log 2024-04-01T15:24:47.650 INFO:teuthology.orchestra.run.smithi142.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45948.log.gz 2024-04-01T15:24:47.650 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44164.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44164.log.gz 2024-04-01T15:24:47.650 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44159.log 2024-04-01T15:24:47.650 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46426.log 2024-04-01T15:24:47.650 INFO:teuthology.orchestra.run.smithi142.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45990.log.gz 2024-04-01T15:24:47.650 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2024-04-01T15:24:47.650 INFO:teuthology.orchestra.run.smithi142.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44159.log.gz 2024-04-01T15:24:47.652 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36744.log 2024-04-01T15:24:47.652 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36784.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36784.log.gz 2024-04-01T15:24:47.653 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46426.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46426.log.gz 2024-04-01T15:24:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46468.log 2024-04-01T15:24:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43828.log 2024-04-01T15:24:47.654 INFO:teuthology.orchestra.run.smithi142.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2024-04-01T15:24:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43312.log 2024-04-01T15:24:47.654 INFO:teuthology.orchestra.run.smithi142.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46468.log.gz 2024-04-01T15:24:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43489.log 2024-04-01T15:24:47.654 INFO:teuthology.orchestra.run.smithi142.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43828.log.gz 2024-04-01T15:24:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44656.log 2024-04-01T15:24:47.657 INFO:teuthology.orchestra.run.smithi142.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43312.log.gz 2024-04-01T15:24:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46200.log 2024-04-01T15:24:47.658 INFO:teuthology.orchestra.run.smithi142.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43489.log.gz 2024-04-01T15:24:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44656.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44656.log.gz 2024-04-01T15:24:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45426.log 2024-04-01T15:24:47.659 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36744.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36744.log.gz 2024-04-01T15:24:47.659 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T15:24:47.659 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36824.log 2024-04-01T15:24:47.659 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.36824.log: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-01T15:24:47.659 INFO:teuthology.orchestra.run.smithi179.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36824.log.gz 2024-04-01T15:24:47.659 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-01T15:24:47.661 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-01T15:24:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43493.log 2024-04-01T15:24:47.663 INFO:teuthology.orchestra.run.smithi142.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46200.log.gz 2024-04-01T15:24:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44530.log 2024-04-01T15:24:47.663 INFO:teuthology.orchestra.run.smithi142.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45426.log.gz 2024-04-01T15:24:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42850.log 2024-04-01T15:24:47.663 INFO:teuthology.orchestra.run.smithi142.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43493.log.gz 2024-04-01T15:24:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44530.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44530.log.gz 2024-04-01T15:24:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43825.log 2024-04-01T15:24:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42490.log 2024-04-01T15:24:47.664 INFO:teuthology.orchestra.run.smithi142.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42850.log.gz 2024-04-01T15:24:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46032.log 2024-04-01T15:24:47.665 INFO:teuthology.orchestra.run.smithi142.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43825.log.gz 2024-04-01T15:24:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42892.log 2024-04-01T15:24:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46032.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42490.log.gz 2024-04-01T15:24:47.666 INFO:teuthology.orchestra.run.smithi142.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46032.log.gz 2024-04-01T15:24:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45906.log 2024-04-01T15:24:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44572.log 2024-04-01T15:24:47.668 INFO:teuthology.orchestra.run.smithi142.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42892.log.gz 2024-04-01T15:24:47.668 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2024-04-01T15:24:47.668 INFO:teuthology.orchestra.run.smithi142.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45906.log.gz 2024-04-01T15:24:47.669 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45720.log 2024-04-01T15:24:47.670 INFO:teuthology.orchestra.run.smithi142.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44572.log.gz 2024-04-01T15:24:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44108.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz -5 2024-04-01T15:24:47.671 INFO:teuthology.orchestra.run.smithi142.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2024-04-01T15:24:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44166.log 2024-04-01T15:24:47.672 INFO:teuthology.orchestra.run.smithi142.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45720.log.gz 2024-04-01T15:24:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43102.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T15:24:47.673 INFO:teuthology.orchestra.run.smithi142.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2024-04-01T15:24:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44362.log 2024-04-01T15:24:47.674 INFO:teuthology.orchestra.run.smithi142.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44166.log.gz 2024-04-01T15:24:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46720.log 2024-04-01T15:24:47.676 INFO:teuthology.orchestra.run.smithi142.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T15:24:47.676 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42976.log 2024-04-01T15:24:47.677 INFO:teuthology.orchestra.run.smithi142.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44362.log.gz 2024-04-01T15:24:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43815.log 2024-04-01T15:24:47.678 INFO:teuthology.orchestra.run.smithi142.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46720.log.gz 2024-04-01T15:24:47.679 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42976.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42976.log.gz 2024-04-01T15:24:47.679 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46242.log 2024-04-01T15:24:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44165.log 2024-04-01T15:24:47.680 INFO:teuthology.orchestra.run.smithi142.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43815.log.gz 2024-04-01T15:24:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36945.log 2024-04-01T15:24:47.681 INFO:teuthology.orchestra.run.smithi142.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46242.log.gz 2024-04-01T15:24:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44908.log 2024-04-01T15:24:47.683 INFO:teuthology.orchestra.run.smithi142.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44165.log.gz 2024-04-01T15:24:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.36945.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36945.log.gz 2024-04-01T15:24:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45636.log 2024-04-01T15:24:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44160.log 2024-04-01T15:24:47.685 INFO:teuthology.orchestra.run.smithi142.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44908.log.gz 2024-04-01T15:24:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42413.log 2024-04-01T15:24:47.686 INFO:teuthology.orchestra.run.smithi142.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45636.log.gz 2024-04-01T15:24:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45846.log 2024-04-01T15:24:47.687 INFO:teuthology.orchestra.run.smithi142.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44160.log.gz 2024-04-01T15:24:47.688 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42413.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42413.log.gz 2024-04-01T15:24:47.688 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45288.log 2024-04-01T15:24:47.689 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44404.log 2024-04-01T15:24:47.689 INFO:teuthology.orchestra.run.smithi142.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45846.log.gz 2024-04-01T15:24:47.690 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45804.log 2024-04-01T15:24:47.692 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44404.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-01T15:24:47.692 INFO:teuthology.orchestra.run.smithi142.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44404.log.gz 2024-04-01T15:24:47.693 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44698.log 2024-04-01T15:24:47.693 INFO:teuthology.orchestra.run.smithi142.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45804.log.gz 2024-04-01T15:24:47.694 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43482.log 2024-04-01T15:24:47.696 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44782.log 2024-04-01T15:24:47.696 INFO:teuthology.orchestra.run.smithi142.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44698.log.gz 2024-04-01T15:24:47.697 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43482.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43482.log.gz 2024-04-01T15:24:47.697 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44824.log 2024-04-01T15:24:47.698 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-mon.c.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-01T15:24:47.699 INFO:teuthology.orchestra.run.smithi179.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-01T15:24:47.699 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44782.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45288.log.gz 2024-04-01T15:24:47.699 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42594.log 2024-04-01T15:24:47.699 INFO:teuthology.orchestra.run.smithi142.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44782.log.gz 2024-04-01T15:24:47.700 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46678.log 2024-04-01T15:24:47.700 INFO:teuthology.orchestra.run.smithi142.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44824.log.gz 2024-04-01T15:24:47.701 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42594.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42594.log.gz 2024-04-01T15:24:47.701 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44488.log 2024-04-01T15:24:47.702 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43060.log 2024-04-01T15:24:47.703 INFO:teuthology.orchestra.run.smithi142.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46678.log.gz 2024-04-01T15:24:47.703 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43270.log 2024-04-01T15:24:47.704 INFO:teuthology.orchestra.run.smithi142.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44488.log.gz 2024-04-01T15:24:47.705 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43186.log 2024-04-01T15:24:47.705 INFO:teuthology.orchestra.run.smithi142.stderr: 88.9%/var/log/ceph/ceph-client.admin.43270.log: -- replaced with /var/log/ceph/ceph-client.admin.43060.log.gz 2024-04-01T15:24:47.706 INFO:teuthology.orchestra.run.smithi142.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43270.log.gz 2024-04-01T15:24:47.706 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45552.log 2024-04-01T15:24:47.707 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42806.log 2024-04-01T15:24:47.708 INFO:teuthology.orchestra.run.smithi142.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43186.log.gz 2024-04-01T15:24:47.709 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45552.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45552.log.gz 2024-04-01T15:24:47.709 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2024-04-01T15:24:47.710 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46074.log 2024-04-01T15:24:47.710 INFO:teuthology.orchestra.run.smithi142.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42806.log.gz 2024-04-01T15:24:47.711 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45510.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2024-04-01T15:24:47.711 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-01T15:24:47.712 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2024-04-01T15:24:47.713 INFO:teuthology.orchestra.run.smithi142.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46074.log.gz 2024-04-01T15:24:47.714 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42934.log 2024-04-01T15:24:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46510.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2024-04-01T15:24:47.716 INFO:teuthology.orchestra.run.smithi142.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43824.log 2024-04-01T15:24:47.717 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44950.log 2024-04-01T15:24:47.717 INFO:teuthology.orchestra.run.smithi142.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42934.log.gz 2024-04-01T15:24:47.718 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43824.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-01T15:24:47.718 INFO:teuthology.orchestra.run.smithi142.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43824.log.gz 2024-04-01T15:24:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43488.log 2024-04-01T15:24:47.720 INFO:teuthology.orchestra.run.smithi142.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44950.log.gz 2024-04-01T15:24:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42552.log 2024-04-01T15:24:47.722 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36689.log 2024-04-01T15:24:47.722 INFO:teuthology.orchestra.run.smithi142.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43488.log.gz 2024-04-01T15:24:47.724 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43484.log 2024-04-01T15:24:47.724 INFO:teuthology.orchestra.run.smithi142.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42552.log.gz 2024-04-01T15:24:47.725 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.36689.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30868.log 2024-04-01T15:24:47.725 INFO:teuthology.orchestra.run.smithi142.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-01T15:24:47.725 INFO:teuthology.orchestra.run.smithi142.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36689.log.gz 2024-04-01T15:24:47.726 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43484.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43484.log.gz 2024-04-01T15:24:47.726 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43830.log 2024-04-01T15:24:47.727 INFO:teuthology.orchestra.run.smithi179.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-01T15:24:47.728 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-01T15:24:47.728 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.tmp-client.admin.30868.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30868.log.gz 2024-04-01T15:24:47.728 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43830.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43830.log.gz 2024-04-01T15:24:47.729 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42314.log 2024-04-01T15:24:47.729 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42678.log 2024-04-01T15:24:47.731 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.42314.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42314.log.gz 2024-04-01T15:24:47.731 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43829.log 2024-04-01T15:24:47.731 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44155.log 2024-04-01T15:24:47.732 INFO:teuthology.orchestra.run.smithi142.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42678.log.gz 2024-04-01T15:24:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44866.log 2024-04-01T15:24:47.733 INFO:teuthology.orchestra.run.smithi142.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43829.log.gz 2024-04-01T15:24:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44155.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T15:24:47.734 INFO:teuthology.orchestra.run.smithi142.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz 2024-04-01T15:24:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45468.log 2024-04-01T15:24:47.735 INFO:teuthology.orchestra.run.smithi142.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44866.log.gz 2024-04-01T15:24:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-01T15:24:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45468.log: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-01T15:24:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43812.log 2024-04-01T15:24:47.738 INFO:teuthology.orchestra.run.smithi142.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45468.log.gz 2024-04-01T15:24:47.738 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43492.log 2024-04-01T15:24:47.740 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46116.log 2024-04-01T15:24:47.740 INFO:teuthology.orchestra.run.smithi142.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43812.log.gz 2024-04-01T15:24:47.742 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42636.log 2024-04-01T15:24:47.742 INFO:teuthology.orchestra.run.smithi142.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43492.log.gz 2024-04-01T15:24:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46116.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46116.log.gz 2024-04-01T15:24:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45678.log 2024-04-01T15:24:47.744 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42636.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42636.log.gz 2024-04-01T15:24:47.745 INFO:teuthology.orchestra.run.smithi179.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-01T15:24:47.746 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.45678.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45678.log.gz 2024-04-01T15:24:47.746 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43228.log 2024-04-01T15:24:47.747 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42762.log 2024-04-01T15:24:47.749 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-04-01T15:24:47.750 INFO:teuthology.orchestra.run.smithi142.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43228.log.gz 2024-04-01T15:24:47.750 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.42762.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42762.log.gz 2024-04-01T15:24:47.751 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46284.log 2024-04-01T15:24:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 2024-04-01T15:24:47.752 INFO:teuthology.orchestra.run.smithi142.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-04-01T15:24:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44446.log 2024-04-01T15:24:47.754 INFO:teuthology.orchestra.run.smithi142.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46284.log.gz 2024-04-01T15:24:47.754 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46594.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2024-04-01T15:24:47.755 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46636.log 2024-04-01T15:24:47.756 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2024-04-01T15:24:47.756 INFO:teuthology.orchestra.run.smithi142.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44446.log.gz 2024-04-01T15:24:47.758 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46636.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-01T15:24:47.758 INFO:teuthology.orchestra.run.smithi142.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46636.log.gz 2024-04-01T15:24:47.759 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2024-04-01T15:24:47.759 INFO:teuthology.orchestra.run.smithi142.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gz 2024-04-01T15:24:47.760 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44992.log 2024-04-01T15:24:47.761 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46552.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-01T15:24:47.762 INFO:teuthology.orchestra.run.smithi142.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2024-04-01T15:24:47.762 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43483.log 2024-04-01T15:24:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.44992.log: gzip -5 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44992.log.gz 2024-04-01T15:24:47.764 INFO:teuthology.orchestra.run.smithi142.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43821.log 2024-04-01T15:24:47.765 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46326.log 2024-04-01T15:24:47.765 INFO:teuthology.orchestra.run.smithi142.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43483.log.gz 2024-04-01T15:24:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.43821.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz 2024-04-01T15:24:47.768 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.46326.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46326.log.gz 2024-04-01T15:24:47.772 INFO:teuthology.orchestra.run.smithi179.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-01T15:24:47.782 INFO:teuthology.orchestra.run.smithi179.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-01T15:24:47.798 INFO:teuthology.orchestra.run.smithi142.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-01T15:24:47.804 INFO:teuthology.orchestra.run.smithi142.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-01T15:24:47.805 INFO:teuthology.orchestra.run.smithi179.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-01T15:24:47.805 INFO:teuthology.orchestra.run.smithi179.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-01T15:24:47.810 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-04-01T15:24:47.810 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m0.217s 2024-04-01T15:24:47.810 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m0.820s 2024-04-01T15:24:47.810 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m0.187s 2024-04-01T15:24:47.824 INFO:teuthology.orchestra.run.smithi142.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-01T15:24:47.868 INFO:teuthology.orchestra.run.smithi142.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-01T15:24:47.887 INFO:teuthology.orchestra.run.smithi142.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-01T15:24:47.891 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-04-01T15:24:47.891 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m0.299s 2024-04-01T15:24:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m0.709s 2024-04-01T15:24:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.380s 2024-04-01T15:24:47.892 INFO:tasks.ceph:Archiving logs... 2024-04-01T15:24:47.892 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/remote/smithi142/log 2024-04-01T15:24:47.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T15:24:48.139 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/remote/smithi179/log 2024-04-01T15:24:48.140 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T15:24:48.340 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-01T15:24:48.356 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-01T15:24:48.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T15:24:48.364 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T15:24:48.515 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-01T15:24:48.524 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-01T15:24:48.524 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T15:24:48.532 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T15:24:48.578 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-04-01T15:24:48.585 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-04-01T15:24:48.588 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T15:24:48.589 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-04-01T15:24:48.589 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +333us[ +336us] +/- 75ms 2024-04-01T15:24:48.589 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 -830us[ -827us] +/- 58ms 2024-04-01T15:24:48.589 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 +729us[ +732us] +/- 67ms 2024-04-01T15:24:48.590 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:24:48.595 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T15:24:48.595 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-04-01T15:24:48.595 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 +335us[ +335us] +/- 75ms 2024-04-01T15:24:48.595 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 -820us[ -750us] +/- 58ms 2024-04-01T15:24:48.595 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +736us[ +736us] +/- 67ms 2024-04-01T15:24:48.595 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T15:24:48.596 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-01T15:24:48.606 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-01T15:24:48.606 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-01T15:24:48.615 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T15:24:48.826 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T15:24:49.032 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T15:24:49.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:24:49.134 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T15:24:49.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:24:49.235 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-01T15:24:49.356 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-01T15:24:49.452 INFO:teuthology.task.internal:Duration was 745.994536 seconds 2024-04-01T15:24:49.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-01T15:24:49.468 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-01T15:24:49.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T15:24:49.477 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T15:24:49.636 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T15:24:49.638 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T15:24:49.971 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-01T15:24:49.971 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-04-01T15:24:49.972 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T15:24:50.032 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-04-01T15:24:50.033 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T15:24:50.097 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-01T15:24:50.097 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T15:24:50.102 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T15:24:50.171 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-01T15:24:50.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T15:24:50.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T15:24:50.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-01T15:24:50.349 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-01T15:24:50.350 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T15:24:50.424 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T15:24:50.515 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-01T15:24:50.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T15:24:50.532 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T15:24:50.629 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-04-01T15:24:50.641 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-04-01T15:24:50.710 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T15:24:50.762 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi142.front.sepia.ceph.com, flagging run as failed 2024-04-01T15:24:50.762 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T15:24:50.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:24:50.816 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-01T15:24:50.826 INFO:teuthology.task.internal:Transferring archived files... 2024-04-01T15:24:50.827 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/remote/smithi142 2024-04-01T15:24:50.827 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T15:24:55.355 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-04-01T15:24:55.481 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914/remote/smithi142/coredump/1711985024.45288.core.gz: gzip compressed data, was "1711985024.45288.core", last modified: Mon Apr 1 15:24:50 2024, max compression, original size modulo 2^32 135294976 2024-04-01T15:24:55.481 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-04-01T15:24:56.023 INFO:teuthology.task.internal: core looks like: /tmp/tmpfcyxud08: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph_test_client', real uid: 1000, effective uid: 1000, real gid: 1301, effective gid: 1301, execfn: '/usr/bin/ceph_test_client', platform: 'x86_64' 2024-04-01T15:24:56.038 INFO:teuthology.task.internal: dump_program: ceph_test_client 2024-04-01T15:24:56.038 DEBUG:teuthology.orchestra.run.smithi142:> which ceph_test_client 2024-04-01T15:24:56.095 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph_test_client 2024-04-01T15:24:56.156 DEBUG:teuthology.orchestra.remote:smithi142:/usr/bin/ceph_test_client is 3MB 2024-04-01T15:24:56.318 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-01T15:24:56.374 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.xJBxSgetKq 2024-04-01T15:24:56.374 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /usr/bin/ceph_test_client.debug /tmp/tmp.xJBxSgetKq 2024-04-01T15:24:56.465 INFO:teuthology.orchestra.run.smithi142.stderr:cp: cannot stat '/usr/bin/ceph_test_client.debug': No such file or directory 2024-04-01T15:24:56.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:24:56.469 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 363, in fetch_binaries_for_coredumps remote.get_file(debug_path, coredump_path) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 622, in get_file self.run(args=args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo cp /usr/bin/ceph_test_client.debug /tmp/tmp.xJBxSgetKq' 2024-04-01T15:24:56.481 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-01T15:24:56.492 INFO:teuthology.task.internal:Not uploading archives. 2024-04-01T15:24:56.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-01T15:24:56.529 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-01T15:24:56.529 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T15:24:56.546 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T15:24:56.591 INFO:teuthology.orchestra.run.smithi142.stdout: 395173 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 1 15:24 /home/ubuntu/cephtest 2024-04-01T15:24:56.591 INFO:teuthology.orchestra.run.smithi142.stdout: 537913 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 1 15:22 /home/ubuntu/cephtest/mnt.0 2024-04-01T15:24:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: 537914 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 1 15:23 /home/ubuntu/cephtest/mnt.0/client.0 2024-04-01T15:24:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: 552254 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 15:23 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-01T15:24:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: 395174 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 1 15:24 /home/ubuntu/cephtest/archive 2024-04-01T15:24:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: 395176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 15:24 /home/ubuntu/cephtest/archive/syslog 2024-04-01T15:24:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: 395165 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 1 15:12 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-01T15:24:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: 395166 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 1 15:12 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-01T15:24:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: 395167 184 -rw-r--r-- 1 ubuntu ubuntu 185084 Apr 1 15:24 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T15:24:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: 526117 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 15:24 /home/ubuntu/cephtest/archive/audit 2024-04-01T15:24:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: 526119 128 -rw------- 1 ubuntu ubuntu 127777 Apr 1 15:24 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-01T15:24:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: 395175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 15:23 /home/ubuntu/cephtest/archive/coredump 2024-04-01T15:24:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: 395168 8080 -rw------- 1 ubuntu ubuntu 135294976 Apr 1 15:23 /home/ubuntu/cephtest/archive/coredump/1711985024.45288.core 2024-04-01T15:24:56.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T15:24:56.595 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-01T15:24:56.595 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 363, in fetch_binaries_for_coredumps remote.get_file(debug_path, coredump_path) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 622, in get_file self.run(args=args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo cp /usr/bin/ceph_test_client.debug /tmp/tmp.xJBxSgetKq' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-01T15:24:56.609 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-01T15:24:56.620 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-01T15:24:56.630 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi142 with status 1: 'sudo cp /usr/bin/ceph_test_client.debug /tmp/tmp.xJBxSgetKq' 2024-04-01T15:24:56.630 INFO:teuthology.nuke:Checking targets against current locks 2024-04-01T15:24:56.638 INFO:teuthology.orchestra.run.smithi179.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 1 15:24 /home/ubuntu/cephtest 2024-04-01T15:24:56.638 INFO:teuthology.orchestra.run.smithi179.stdout: 393230 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 1 15:24 /home/ubuntu/cephtest/archive 2024-04-01T15:24:56.639 INFO:teuthology.orchestra.run.smithi179.stdout: 393232 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 15:24 /home/ubuntu/cephtest/archive/syslog 2024-04-01T15:24:56.639 INFO:teuthology.orchestra.run.smithi179.stdout: 393402 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 1 15:12 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-01T15:24:56.639 INFO:teuthology.orchestra.run.smithi179.stdout: 393242 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 1 15:12 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-01T15:24:56.639 INFO:teuthology.orchestra.run.smithi179.stdout: 393241 180 -rw-r--r-- 1 ubuntu ubuntu 184094 Apr 1 15:24 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T15:24:56.639 INFO:teuthology.orchestra.run.smithi179.stdout: 526095 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 15:24 /home/ubuntu/cephtest/archive/audit 2024-04-01T15:24:56.639 INFO:teuthology.orchestra.run.smithi179.stdout: 526378 120 -rw------- 1 ubuntu ubuntu 120054 Apr 1 15:24 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-01T15:24:56.640 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-01T15:24:56.664 DEBUG:teuthology.nuke:shortname: smithi142 2024-04-01T15:24:56.664 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T15:24:56.691 DEBUG:teuthology.nuke:shortname: smithi179 2024-04-01T15:24:56.691 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T15:24:56.696 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 15:02:33.529712', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDnUHOvfKGdJEm2fodfNtmvZNnB+RGSUECNtfnLkPDR6jx+5cNpV1Cm0OTNCsKrk0zc9NUNPbM/M7JZwvW0v6MU='} 2024-04-01T15:24:56.722 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633914', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 15:02:33.532517', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfqfJJuK2zrLLFX5mk7FrAsOBmKCSPKLBp5b8hvInZnN6q4HxWgjBPJ2hvmrPj2ZpOqll5lKCE3BtNr1Y/BsWI='} 2024-04-01T15:24:56.750 INFO:teuthology.orchestra.console.smithi142:Power off 2024-04-01T15:24:56.750 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T15:24:56.773 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-04-01T15:24:56.774 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:24:56.789 INFO:teuthology.orchestra.console.smithi179:Power off 2024-04-01T15:24:56.789 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T15:24:56.798 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-01T15:24:56.811 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-04-01T15:24:56.811 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:24:56.837 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-01T15:25:00.800 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:25:00.838 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:25:00.911 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-01T15:25:00.949 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-01T15:25:04.915 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:25:04.950 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:25:05.027 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-01T15:25:05.061 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-01T15:25:05.161 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-04-01T15:25:09.030 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T15:25:09.140 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-01T15:25:09.241 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-04-01T15:25:09.347 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client} duration: 745.9945363998413 failure_reason: 'Command failed (workunit test client/test.sh) on smithi142 with status 134: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2271579d5e735cfd6d436b8349c004f06527cb0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh''' flavor: default mon.a-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 mon.b-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=939d1f229cbf48c293ef631bfc73a5d7 status: fail success: false 2024-04-01T15:25:09.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T15:25:09.428 INFO:teuthology.run:FAIL